-- Logs begin at Tue 2022-08-23 22:44:11 UTC, end at Tue 2022-08-23 23:46:35 UTC. -- Aug 23 23:17:29.567306 dv-osbrick-853458-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 23:17:29.577027 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 23:17:29 2022] *** Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: nodename: dv-osbrick-853458-3-ceph Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: machine: x86_64 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: clock source: unix Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: pcre jit disabled Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: detected number of CPU cores: 4 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: current working directory: / Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: detected binary path: /usr/bin/uwsgi-core Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: your processes number limit is 47680 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: your memory page size is 4096 bytes Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: detected max file descriptor number: 2048 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: lock engine: pthread robust mutexes Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: thunder lock: enabled Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 23:17:29.583465 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 23:17:29.624501 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: Python main interpreter initialized at 0x55a383ddb9c0 Aug 23 23:17:29.624501 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: python threads support enabled Aug 23 23:17:29.624501 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: your server socket listen backlog is limited to 100 connections Aug 23 23:17:29.624501 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: your mercy for graceful operations on workers is 90 seconds Aug 23 23:17:29.624930 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 23:17:29.624930 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: *** Operational MODE: preforking *** Aug 23 23:17:29.625201 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: *** uWSGI is running in multiple interpreter mode *** Aug 23 23:17:29.625201 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: spawned uWSGI master process (pid: 88315) Aug 23 23:17:29.625464 dv-osbrick-853458-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 23:17:29.628541 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: spawned uWSGI worker 1 (pid: 88323, cores: 1) Aug 23 23:17:29.628541 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: spawned uWSGI worker 2 (pid: 88324, cores: 1) Aug 23 23:17:29.628541 dv-osbrick-853458-3-ceph devstack@keystone.service[88315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 23:17:34.542625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:17:34.542625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: from cryptography.utils import int_from_bytes Aug 23 23:17:34.543819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:17:34.543819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: from cryptography.utils import int_from_bytes Aug 23 23:17:34.547471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:17:34.547471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: from cryptography.utils import int_from_bytes Aug 23 23:17:34.548261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:17:34.548261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: from cryptography.utils import int_from_bytes Aug 23 23:17:34.598883 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:17:34.599277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:17:34.599277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] command line args: [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:17:34.599527 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:17:34.599693 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ================================================================================ {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:17:34.599972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] admin_token = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.600222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] config_dir = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.600324 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:17:34.600409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.600532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:17:34.600611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] config_source = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.600743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] debug = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.600866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] command line args: [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:17:34.600992 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.601307 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:17:34.601412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.601518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.601590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ================================================================================ {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:17:34.601746 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.601920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] admin_token = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602210 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] config_dir = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_config_append = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602771 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_dir = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.602897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_file = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] config_source = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] debug = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603548 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.603867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604701 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.604861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605373 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605373 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605640 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.605880 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_config_append = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.606028 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.606120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.606389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_dir = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_file = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607569 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607569 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] publish_errors = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.607977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.608877 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] standard_threads = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609355 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609355 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] use_journal = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.609954 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] use_json = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] use_stderr = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] use_syslog = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.610724 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.610816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.610895 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.611067 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.611213 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.611308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.611549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.611684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.611783 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.611998 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.612130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.612280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.612360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.612530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.612779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.613019 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.613119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.613243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.613322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] publish_errors = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.613492 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.613600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.613728 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.613951 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.614046 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.614208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.614298 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.614515 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.614648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.614810 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.614971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.615132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.615258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.615362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] standard_threads = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.615474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.615738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.615948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.616109 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.616342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.616520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.616631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.616733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.616830 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] use_journal = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.616898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.617032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.617155 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] use_json = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.617276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.617390 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] use_stderr = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.617540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.617661 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] use_syslog = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.617836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.618030 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.618128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:17:34.618271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.618479 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.618681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.618972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619122 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619422 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.619816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620729 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.620957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.621792 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.622217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.622576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.622767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.622903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.622983 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.623117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.623278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.623383 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.623726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.623838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624232 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624820 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.624901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625226 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625584 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.625895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626031 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626428 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626850 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.626991 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627401 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627751 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.627945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.628832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629160 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629291 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629807 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.629952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630093 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630384 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630512 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.630885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631037 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631165 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631770 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.631958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632205 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632359 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632753 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.632930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633405 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.633953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.634981 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635452 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635723 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.635998 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636710 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.636844 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.637074 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.637385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.637535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.external = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.637727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638038 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638244 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.638845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639032 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.password = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] auth.token = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639691 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.639827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640457 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.640960 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641083 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641740 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.641878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642112 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.642803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643437 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.643858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644653 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.644908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645052 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645674 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.645993 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.646910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647171 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647482 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.647816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.648935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.649962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.650876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651482 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.651926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652195 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.external = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.652873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.653066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.653304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.password = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.653546 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] auth.token = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.653824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.653966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654554 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654820 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.654952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.655833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.656795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657154 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657802 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.657936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.658133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.658316 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.658496 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.658733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.658863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.659089 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.659213 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.659430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.659653 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.659779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660017 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660543 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660674 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.660937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.661926 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.662180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.662310 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.662533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.662667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.662902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663267 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.663938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.664957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665352 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665688 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665770 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.665937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666467 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666729 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.666880 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667066 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667435 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.667844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.668883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.669129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.669382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.669536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.669632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.669892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.670783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.671112 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.671536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.671720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.672419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.673157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.673694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.674523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.674523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675171 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.675935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676323 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676694 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676814 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.676915 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677123 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677550 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677550 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677748 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.677954 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678171 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678691 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678819 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.678896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679008 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679008 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679485 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679589 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.679909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680330 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680665 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680665 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.680972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681203 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681203 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681334 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681743 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.681998 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.682205 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.682290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.682469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.682689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.682822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.683047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.683159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.683435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.683525 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.683717 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684204 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684340 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.684987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685287 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.685900 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686453 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686586 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686857 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.686997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] role.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.687827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688145 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] role.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.688912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689314 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] role.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] role.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.689958 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690206 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690387 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.690930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691401 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.691932 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.692977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.693095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.693292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.693535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.693769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.693857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694016 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694196 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694276 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.694744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.695860 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.696073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.696206 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.696456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.696592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.696826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.697033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.697291 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.697543 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.697635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698117 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.698895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.699194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.699502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.699689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.699926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.700166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.700408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.700659 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.700788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.700911 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701144 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.701929 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.702906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.703106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.703262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.703389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.703666 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.703795 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.704027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.704175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.704327 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.704446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.704573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.705298 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.705456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.705599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.connection = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.705790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.705940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706486 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706743 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.706871 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.707858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708341 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708470 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.708872 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.connection = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709707 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.709983 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.710113 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:17:34.710351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.710818 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.711156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.711457 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.711751 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.712085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.712384 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.712681 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.713003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.713259 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.713535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.713837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.714121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.714417 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.714699 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.714987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.715948 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:17:34.716244 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:17:34.740007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.740221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.740429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.742058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.742289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.742513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.749462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.751793 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.777956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.778186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.780781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.781013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.833955 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.834738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.884193 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.884407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.885918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.886155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.952773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.952992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953417 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.953984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.954211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.954428 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.954650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.955724 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.979808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980370 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980598 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.980881 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.981114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.981312 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.981394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.981535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.981917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.993106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:34.993333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.006406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.006570 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.006719 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.006803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.006946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007093 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.007801 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:17:35.025077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.025293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.025382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:17:35.025532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:17:35.025614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.025741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.025819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:17:35.025947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:17:35.026038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.026986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.036468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.036751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.036990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.037139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.037285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.037422 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.037619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.037915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.044214 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.045498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.047207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.047462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.047749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.048082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.048360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.048525 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.048749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.048859 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.048958 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049112 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049463 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.049989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.050272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.050617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.050789 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.051065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.072511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.073974 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.074251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.078540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.078920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.079204 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.079485 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.080367 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.080654 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.085229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.085460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.085743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.087860 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.088190 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.092767 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.092767 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.093015 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.093103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.093235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.093349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.093593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.093873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.094141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.094400 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.097243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.097531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.097811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.098099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.098385 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.098781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.099313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.099313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.110208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.110485 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.114333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.115459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.115742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.117787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.118085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.119638 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.122775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.123389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.123689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.125909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.128179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.129063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.129359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.129647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.129920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.130189 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.130473 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.131280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.134626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.134768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.135043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.135341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.135674 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.136238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.148259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.148608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.148935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.149253 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.155313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.155620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.155922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.156197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.158120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.159737 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.160032 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.162861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.163136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.163268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.163587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.164092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.164553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.164733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.165019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.167962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.168420 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.169297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.169758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.170263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.178306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.178802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.179234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.179583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.180104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.180448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.180851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.182268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.182661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.182874 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.183155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.183434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.183711 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.184578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.202794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.205834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.206092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.209065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.209218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.210516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.212011 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.212125 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.212327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.212613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.213545 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.215017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.215388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.215760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.219817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.221315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.222492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.224118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.224227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.224460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.224747 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.225039 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.226916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.227210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.227496 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.227808 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.234647 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.234939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.235225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.236662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.236957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.237242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.241988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.242376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.242662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.242946 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.243230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.243510 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.243788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.244084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.244372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.244655 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.244947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:17:35.245218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245378 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245625 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.245880 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.246158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.246518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.246982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.247316 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.248763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.249061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.249343 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.249688 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.249883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.250150 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:17:35.281553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a383ddb9c0 pid: 88324 (default app) Aug 23 23:17:35.285548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f3d2-2c7a-40ef-8321-c6fccf74aa70 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:35.285831 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f3d2-2c7a-40ef-8321-c6fccf74aa70 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:35.286069 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f3d2-2c7a-40ef-8321-c6fccf74aa70 None None] PATH_INFO: `/v3` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:35.289211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a383ddb9c0 pid: 88323 (default app) Aug 23 23:17:35.290417 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Tue Aug 23 23:17:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:42.916274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:42.916870 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:42.916870 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:42.921709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:17:42.927835 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:42.928621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:42.928621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:43.012232 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: INFO dbcounter [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] Registered counter for database keystone Aug 23 23:17:43.032737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:17:43.040828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writer thread running {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:17:43.240969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG passlib.handlers.bcrypt [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88324) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:17:43.241351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG passlib.handlers.bcrypt [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88324) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:17:43.297912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:43.299592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:43.471901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 23:17:44.015699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:44.095400 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: INFO dbcounter [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] Registered counter for database keystone Aug 23 23:17:44.118318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG oslo_db.sqlalchemy.engines [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:17:44.125809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writer thread running {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:17:44.259524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d00ec-eacb-455c-bdfd-ddad7e3c86f6 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:44.264798 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:44.265443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:44.265781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:44.266066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:44.276152 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:44.332942 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:17:44.333282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470239c-8c04-404c-9539-cf4b016ca331 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:44.344123 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Tue Aug 23 23:17:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:17:44.350670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:44.369133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa001d2-8306-4793-83e0-6864daed65ca None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:44.375978 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:44.377273 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:44.377537 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:44.377833 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] PATH_INFO: `/v3/projects/44a6d06c119f40359a0b6c352385f165` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:44.379766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] RBAC: Authorizing `identity:get_project(project_id=44a6d06c119f40359a0b6c352385f165)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:44.432730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING keystone.common.rbac_enforcer.enforcer [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:17:44.433068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5153-5978-48d8-846c-831fac6d0769 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:44.438597 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Tue Aug 23 23:17:44 2022] GET /identity/v3/projects/44a6d06c119f40359a0b6c352385f165 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:46.740312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08902-0ec5-4716-b3fe-1e89b98b128f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:46.740938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08902-0ec5-4716-b3fe-1e89b98b128f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:46.741168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08902-0ec5-4716-b3fe-1e89b98b128f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:46.748993 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:46.755801 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:46.756709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:46.756709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:46.783965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:46.785681 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:46.801100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 23:17:47.422609 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08902-0ec5-4716-b3fe-1e89b98b128f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:47.438462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08902-0ec5-4716-b3fe-1e89b98b128f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:47.442875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:47.443484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:47.443771 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:47.444080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:47.453444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:47.455617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917bf00-779a-4291-ad1f-0e715c7dadf9 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:47.466169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Tue Aug 23 23:17:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:17:47.475674 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:47.492170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6e4a-ca0c-43b3-aea2-9e706ca0dae8 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:47.500001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:47.501061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:47.501540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:47.502026 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:47.504401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:47.507687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f10926-9d04-4b5b-bcb1-c594a8ef5c00 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:47.509920 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Tue Aug 23 23:17:47 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:50.071488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd63d5-81df-4ff2-b661-1e1524aedcdc None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.072423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd63d5-81df-4ff2-b661-1e1524aedcdc None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.072423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd63d5-81df-4ff2-b661-1e1524aedcdc None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.075697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:50.084182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.084850 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.084850 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.114721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:50.116186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.153759 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b71ff6-7651-4622-b5d6-61402a59da88 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.154033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b71ff6-7651-4622-b5d6-61402a59da88 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.154302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b71ff6-7651-4622-b5d6-61402a59da88 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.155650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:17:50.163551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.163986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.164414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.230781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG passlib.handlers.bcrypt [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:17:50.231328 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG passlib.handlers.bcrypt [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:17:50.281394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:50.284313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.389110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:17:50.429521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:17:50.735216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:50.753608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:50.763733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:50.882150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9337b3d-0aff-450c-90bd-0983dca788da None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:50.897242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f03d0d-5a65-4e6c-aabe-1b1731e324ac None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:50.900596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:50.942884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:50.943641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.944088 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.944452 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.951409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:50.952615 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.952888 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.953160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.969635 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:17:50.979418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:17:50.982425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:17:50.987585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 8/14] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:17:50.988684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.030713 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.033059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.064929 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.128388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258dcdc-f91e-45bf-a094-1ec8bd8be0a8 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.173413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.174031 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.174308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.174575 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.175246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:51.175546 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.177074 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.177187 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 7/15] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:17:51.183366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.191174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 9/16] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:17:51.199684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.243086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.341451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ead289-3f87-4af4-8629-729a0ba67d17 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.368986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d40cc-dd18-44f2-96cf-9e56688665b5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.373869 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.390212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.390856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.391133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.391400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.408497 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.411236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.429914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.430941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.431408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.431920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.434748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:17:51.437401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:17:51.438836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:17:51.439631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:17:51.439631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:17:51.439631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:17:51.439795 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.439896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 8/17] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:17:51.444057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 10/18] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:17:51.446262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.448525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.573109 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22059e-81ae-40b4-8275-7872b2719493 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.632678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.633547 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.634144 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.634580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.636104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:51.636561 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.638701 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.665917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 9/19] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:51.749461 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.758630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058e21-bac8-4d8c-a154-876959ee7a29 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.806735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.807516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.807957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.808312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.809769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.811534 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5c53-2963-43ac-8635-c67472e47f1f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.814063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 11/20] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:51.823519 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.885165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:52.004146 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748687b-8dd5-433a-a883-e018c3702e77 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:52.075513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:52.076519 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:52.077011 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:52.077565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:52.078899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.domain.id=default, user.id=3f7bbb00e65c4b7393cbc41f848a6216) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:52.079706 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:52.081559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb06679-96d7-4bc9-b17e-b6a012cdb566 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:52.091493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 10/21] 10.222.0.75 () {56 vars in 1322 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/role_assignments?user.id=3f7bbb00e65c4b7393cbc41f848a6216&scope.domain.id=default&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 233 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:55.752662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014abab7-605f-4dc6-9c1c-2270112df89a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:55.753773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014abab7-605f-4dc6-9c1c-2270112df89a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:55.754245 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014abab7-605f-4dc6-9c1c-2270112df89a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:55.756454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 12/22] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:55.765590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729e4-da58-4ff5-9e08-1ddf56299723 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:55.766721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729e4-da58-4ff5-9e08-1ddf56299723 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:55.767448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729e4-da58-4ff5-9e08-1ddf56299723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:55.798001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f19729e4-da58-4ff5-9e08-1ddf56299723 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:55.799782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f19729e4-da58-4ff5-9e08-1ddf56299723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:55.926396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 11/23] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:17:55.937812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd52f99-2dfe-4a6e-aad1-bb40c2ab1470 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:55.938442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd52f99-2dfe-4a6e-aad1-bb40c2ab1470 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:55.938956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd52f99-2dfe-4a6e-aad1-bb40c2ab1470 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:55.941041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:17:55.953579 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90817-056a-4d93-8ab7-57333c2bb035 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:55.954644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90817-056a-4d93-8ab7-57333c2bb035 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:55.955124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90817-056a-4d93-8ab7-57333c2bb035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:55.980509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-12e90817-056a-4d93-8ab7-57333c2bb035 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:55.982571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-12e90817-056a-4d93-8ab7-57333c2bb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:56.024395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:56.101118 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 12/25] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:17:56.194121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4ef0-dbbc-4e47-8178-3c0d2a0fad2a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.194752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4ef0-dbbc-4e47-8178-3c0d2a0fad2a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.195273 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4ef0-dbbc-4e47-8178-3c0d2a0fad2a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.197087 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 14/26] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:17:56.206004 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.206847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.207342 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.221623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb672-eb81-4b9b-990b-c40d8215d35d None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.222315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb672-eb81-4b9b-990b-c40d8215d35d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.222807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb672-eb81-4b9b-990b-c40d8215d35d None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.224957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 15/27] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:56.248915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:56.249686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.250196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.250688 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.250956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:56.311480 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:56.313316 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:56.444725 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 13/28] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:17:56.492153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 16/29] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 23:17:56.659711 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:56.818215 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:56.842162 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd832-7cd2-4343-911f-a2ddafb902ab None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:56.922845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:56.923916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.924512 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.925157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.949473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:56.951345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:17:56.978943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:17:56.980737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:17:56.981635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:17:56.981635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:17:56.981635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:17:56.983602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:56.986125 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 14/30] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:17:56.993590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:57.201407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f631-2b8e-4226-8d4c-4e97fc072ab6 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:57.234294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:57.246170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab87a-3499-49c9-91db-5f9a7af42250 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:57.253446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:57.254396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.254911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.255295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.256097 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:57.256429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:57.258093 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:57.269775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:57.276501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 15/31] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:17:57.278264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:57.296947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:57.298125 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.298704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.299310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.300540 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:57.303127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:57.445010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b151-31f8-4990-a357-e2a558541073 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:57.508401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:57.509146 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.509546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.509851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.524175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 17/32] 10.222.0.75 () {60 vars in 1131 bytes} [Tue Aug 23 23:17:56 2022] POST /identity/v3/roles => generated 219 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:57.524175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:57.546679 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:17:57.560558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:17:57.562262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:17:57.563744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 16/33] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:17:57.564990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:57.659738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:57.695539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af322ed-db92-4fde-8e38-6eebaf539d1c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:57.729604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857c80b-a4ea-4386-8f94-54abf95ff3ff None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:57.748895 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:57.749758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.750202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.750607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.751418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:57.753963 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387ae8-8303-459e-a4a5-fa6e8dea002e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:57.776049 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:57.776745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.777528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.777644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 18/34] 10.222.0.75 () {60 vars in 1131 bytes} [Tue Aug 23 23:17:57 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:57.777731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.778227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:57.779413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce20411-a163-4aac-a360-a1bf46b3d79b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.779703 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a291c-eb61-4337-8442-66ae90173d71 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:57.779848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce20411-a163-4aac-a360-a1bf46b3d79b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.780150 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce20411-a163-4aac-a360-a1bf46b3d79b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.781578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 19/35] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:57.782611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180705-5f52-4f33-a561-f6634a934486 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.782904 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180705-5f52-4f33-a561-f6634a934486 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.783253 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180705-5f52-4f33-a561-f6634a934486 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.784829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 20/36] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:57.785839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180705-5f52-4f33-a561-f6634a934486 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:57.812106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:57.961626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 17/37] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:17:57 2022] POST /identity/v3/projects => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:57.963142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:57.963427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:57.963702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:57.995214 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180705-5f52-4f33-a561-f6634a934486 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:58.012718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:58.016779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:58.057580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:58.058404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.058881 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.059782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.060040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:58.060318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:58.061749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881cd9-156a-495e-86b1-877a1e44ad69 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:58.071962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 21/38] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:58.073060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.073478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.073833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.101367 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:58.103147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:58.152690 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 18/39] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:17:58.153661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.219963 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:58.245094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 22/40] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:17:58.323514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e52d-08b5-4d22-849c-5995425234cb None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:58.387742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:58.388815 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.389519 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.390172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.391900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:58.393827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:58.395683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 19/41] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:17:58 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:58.402460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.408387 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:58.566671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af882029-c6d6-45f2-b40a-ff1f98e31beb None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:58.581585 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.616604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:58.617515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.617882 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.618289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.619719 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:58.621673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:58.623493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 23/42] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:58.624810 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.718828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca9a2-312f-4876-a2b8-00da68fa3aac None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:58.724296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:58.734597 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:58.762778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b5e1-b738-4ff7-a83c-9511b89dd5ae None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:58.763607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:58.764303 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.764575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.764841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.767119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:58.768695 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:58.770382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 20/43] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:17:58.771159 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.812496 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:58.813449 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:58.813934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:58.814431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:58.815669 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:58.817584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:58.834804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 24/44] 10.222.0.75 () {60 vars in 1131 bytes} [Tue Aug 23 23:17:58 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:58.840626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:58.970814 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7ff9-a658-439b-a7d3-681f853d10a1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:59.022657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76619a3-28e1-464d-b006-4abcb624acb5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:59.024767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:59.025464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:59.025816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:59.026101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] PATH_INFO: `/v3/domains/default/users/3f7bbb00e65c4b7393cbc41f848a6216/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:59.028508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3f7bbb00e65c4b7393cbc41f848a6216, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:59.030191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d04c1-fb55-4afe-902c-60d13c1c29e4 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:59.051240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 21/45] 10.222.0.75 () {58 vars in 1361 bytes} [Tue Aug 23 23:17:58 2022] PUT /identity/v3/domains/default/users/3f7bbb00e65c4b7393cbc41f848a6216/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:17:59.076738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:59.090011 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:59.090650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:59.090934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:59.091214 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:59.091940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:59.093451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6441-4fdf-48db-875c-9c323f12be90 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:59.149997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 25/46] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:17:58 2022] POST /identity/v3/projects => generated 312 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:01.550513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce908bd5-a502-42cc-8b86-96acc452558a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:01.552848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce908bd5-a502-42cc-8b86-96acc452558a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:01.552848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce908bd5-a502-42cc-8b86-96acc452558a None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:01.552848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 22/47] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:01.559258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:01.559544 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:01.559936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:01.560583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b888-4f29-44c4-b1b0-a912f07bcfcb None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:01.561065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b888-4f29-44c4-b1b0-a912f07bcfcb None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:01.561555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b888-4f29-44c4-b1b0-a912f07bcfcb None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:01.563228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 26/48] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:01.569718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:01.570091 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:01.570554 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:01.583050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:01.584446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:01.592196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:01.594504 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:01.629001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:01.675147 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 23/49] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:01.680657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 27/50] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:02.007169 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.007796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.133855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b13d48-cad1-4eca-afb3-cfc8a43d8acd None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.150937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:02.151556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dcfdc-05ca-4867-a34c-a0e4be4c143a None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.179124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.180345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.180990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.181308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.183416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:02.185452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:02.187674 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 28/51] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:02.193643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.199046 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.199744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.200059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.200340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.214921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:02.220959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:02.222054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:02.222902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 24/52] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:02.228846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.272767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:02.336510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078055ec-86a4-4447-934f-5f7d6f2f735e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.380589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e96d0-d05c-4958-9bd2-c4cb014162b0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.382224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.383382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.383952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.384461 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.385837 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:02.388764 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:02.425350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 29/53] 10.222.0.75 () {60 vars in 1140 bytes} [Tue Aug 23 23:18:02 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:18:02.426300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.426955 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.427239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.427506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.428306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:02.428616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:02.430215 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:02.446568 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 25/54] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:02.453449 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.499067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:02.613252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584889ee-2c31-446e-b57e-999e6e253321 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.666799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.667450 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.667740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.668055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.669263 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:02.670727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:02.672408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 30/55] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:02.678872 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:02.804222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:02.816551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd22c1-5a07-4bcc-83b4-a7dde6483b0a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:02.860271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:02.860919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:02.861194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:02.861474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:02.862719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:02.864432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb2bf-9d98-442e-bb91-251968880bd2 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:02.866104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 26/56] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:02.872983 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:03.027414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a34d5-17f2-4162-a06f-79ad23784a75 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:03.030183 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:03.074607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:03.075229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:03.075510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:03.075782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:03.076554 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.domain.id=default, user.id=3f7bbb00e65c4b7393cbc41f848a6216) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:03.076863 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:03.078334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a0b3-be74-4606-aa1e-ea8289872373 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:03.099917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 31/57] 10.222.0.75 () {56 vars in 1322 bytes} [Tue Aug 23 23:18:02 2022] GET /identity/v3/role_assignments?user.id=3f7bbb00e65c4b7393cbc41f848a6216&scope.domain.id=default&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 530 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:04.776222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b376-03ce-43d0-9ffa-cb7a2762f270 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:04.776902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b376-03ce-43d0-9ffa-cb7a2762f270 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:04.776902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b376-03ce-43d0-9ffa-cb7a2762f270 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:04.778126 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 27/58] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:04.783662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:04.784211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:04.784329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:04.805863 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:04.808164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:04.908552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 32/59] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:05.244880 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2b376-03ce-43d0-9ffa-cb7a2762f270 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:05.375858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2b376-03ce-43d0-9ffa-cb7a2762f270 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:05.414102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:05.414733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:05.415008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:05.415271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:05.416414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:05.418219 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2483-4475-434e-abea-603ea7c854ac None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:05.419813 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 28/60] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:05.425642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:05.525715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:05.533573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13be40-935b-4d3f-bdc9-b3bcac824236 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:05.573803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:05.574440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:05.574720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:05.574993 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:05.575660 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:05.577208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e731c-293a-445b-8cf1-ffa7ac6dfc40 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:05.609491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 33/61] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:05 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:10.003253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805543-d680-41ba-a080-1c99ca8966a6 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.003853 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805543-d680-41ba-a080-1c99ca8966a6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.004000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805543-d680-41ba-a080-1c99ca8966a6 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.006031 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 29/62] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:10.020301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf855-be32-41b7-a21c-6a52aa3317e0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.021474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf855-be32-41b7-a21c-6a52aa3317e0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.022057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf855-be32-41b7-a21c-6a52aa3317e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.032100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511cb9-35cf-4eaf-a5f6-588ef7494a58 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.033100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511cb9-35cf-4eaf-a5f6-588ef7494a58 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.034170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511cb9-35cf-4eaf-a5f6-588ef7494a58 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.038657 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 30/63] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:10.050377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f81d-b511-46cb-af93-d4fd1f5083a4 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.051304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f81d-b511-46cb-af93-d4fd1f5083a4 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.052056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f81d-b511-46cb-af93-d4fd1f5083a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.052975 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-e2edf855-be32-41b7-a21c-6a52aa3317e0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:10.054232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-e2edf855-be32-41b7-a21c-6a52aa3317e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:10.102129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e866f81d-b511-46cb-af93-d4fd1f5083a4 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:10.105552 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e866f81d-b511-46cb-af93-d4fd1f5083a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:10.156185 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:10.207647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 34/64] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:10.242558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 31/65] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:10.424590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021093-ccdd-4687-b446-ec01de2e4037 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.424869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021093-ccdd-4687-b446-ec01de2e4037 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.425321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c021093-ccdd-4687-b446-ec01de2e4037 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.426627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 35/66] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:10.454518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.454802 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.455146 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.482935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:10.484176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:10.577640 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 32/67] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:10.671748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c021093-ccdd-4687-b446-ec01de2e4037 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:10.778876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:10.824463 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:10.883514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c021093-ccdd-4687-b446-ec01de2e4037 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:10.928275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:10.929428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.929710 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.929985 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.940598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:10.946182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-c35c6d1b-4d62-4cf0-8c68-56e202404621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:10.954839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:10.955772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:10.956582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 36/68] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:10.961067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe6f87-f6b9-4d12-a65d-f98804c88879 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:10.961626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe6f87-f6b9-4d12-a65d-f98804c88879 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:10.962112 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe6f87-f6b9-4d12-a65d-f98804c88879 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:10.965224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 37/69] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:10.966996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe6f87-f6b9-4d12-a65d-f98804c88879 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:10.969931 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb713b1f-bc73-4462-a66c-2270b00c167c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.022077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.022897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.023125 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.023302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.037776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-f2d7bbf9-aae3-4f53-a4b9-6de087f76ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:11.042769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:11.043785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 33/70] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:11.048665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193702d-c9a1-43e5-8b0c-4af2f6ffb069 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.049329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193702d-c9a1-43e5-8b0c-4af2f6ffb069 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.049329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193702d-c9a1-43e5-8b0c-4af2f6ffb069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.067194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-9193702d-c9a1-43e5-8b0c-4af2f6ffb069 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:11.068554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-9193702d-c9a1-43e5-8b0c-4af2f6ffb069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:11.108293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe6f87-f6b9-4d12-a65d-f98804c88879 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.146084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 34/71] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:11.147445 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833b9b-5af2-4063-8d7a-802d526615f1 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.147736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833b9b-5af2-4063-8d7a-802d526615f1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.148047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833b9b-5af2-4063-8d7a-802d526615f1 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.149376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 35/72] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:11.151852 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21833b9b-5af2-4063-8d7a-802d526615f1 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.158054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.158709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.158995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.159283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.160048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:11.160358 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:11.161875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:11.171760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 38/73] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:11.172722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.180318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.269108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.309838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21833b9b-5af2-4063-8d7a-802d526615f1 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.317313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91133988-808e-4d1d-84ff-82fc70313b6d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.358496 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.359493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.359994 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.360441 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.368690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.370088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.370088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.370537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.371280 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:11.371599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:11.375252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aade2d-4a77-41f1-afba-ea86e4667039 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:11.380679 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:11.392045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 39/74] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:11.392045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.392045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.392045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:11.392410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:11.393178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 36/75] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:11.393956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.415958 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:11.417451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:11.502974 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.513021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 40/76] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:11.513021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.532907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7cbf-a476-4d2d-8f32-6c87c031c899 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.586754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.587556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.587786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.588113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.589916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:11.592460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:11.600279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 37/77] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:11.600279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.600279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.683479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0acc-32b5-4929-8092-2413e1f1c9ef None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.734847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91f70-43a6-4286-bbf6-f7fe687393d3 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.739993 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.740976 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.741391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.741796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.760783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:11.762787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:11.764929 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 41/78] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:11.766065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.789862 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.790564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.790821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.791100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.791943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:11.792256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:11.793701 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:11.808971 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 38/79] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:11.810141 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:11.869186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.905077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:11.926908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b469e4-280e-47f7-ae53-befaaf8d10d4 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.959393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadfe1e-d1c4-44ad-a286-fde3236e056f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:11.967313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:11.968258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:11.968626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:11.969000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:11.982025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:11.986972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:11.987848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:11.988623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 42/80] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:11.989816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.019300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.020022 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.020526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.021010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.121497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28e16-5495-4f3f-b200-519643cdc0a6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.122914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.124500 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.138881 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.163587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.164736 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.165128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.165551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.205747 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.244218 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.246364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.246507 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 39/81] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:12.248052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.374673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 43/82] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:12.375604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.393180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d2de2-7a55-4089-9993-d3f8f71c9994 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.394377 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.437712 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.438348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.438629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.438893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.440135 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.441658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.443324 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 40/83] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:12.444128 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.487344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.512511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb0fc-7ac5-40d0-93fe-13f74d556a26 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.557023 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.557859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.558428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.558758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.560543 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.562398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.564351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 44/84] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:12.565072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.575332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a4b41-f526-432d-b7f6-5b8ba8a0820d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.623156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.623798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.624108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.624397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.625108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:12.625415 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.626891 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.636991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 41/85] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:12.642394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.679836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.701371 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ebc5f-13f3-4159-82bd-1769a393bb71 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.741227 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.741873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.742215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.742458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.743791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.745391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.747506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 45/86] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:12.748398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.777736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.785720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd68c-97b5-4777-83bb-2782d2597264 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.829707 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.830822 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.831308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.831784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.833968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:12.836796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:12.845025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 42/87] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:12.845025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:12.906420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f47-9d43-468e-974a-78aa3f074028 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:12.955154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:12.956153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:12.956503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:12.956899 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:12.977605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:12.981775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23af2f-8fa5-4fc8-92ee-67e72254b0c1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.028582 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.029136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.029415 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.029675 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.030348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.031919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.056039 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.058733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.062740 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 43/88] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:12 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:13.063641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.112764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:13.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 46/89] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:13.213160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.256757 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b106c-ed46-4ff8-84ed-dcf5c5214166 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.310896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:13.318462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.319136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.319419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.319696 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.321931 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.324373 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.326863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 44/90] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:13.328130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.393940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e512-0236-4f0e-9490-0c09c91dc2ef None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.455054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.455718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.456080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.456352 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.457151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=3f7bbb00e65c4b7393cbc41f848a6216) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:13.457506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.459056 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.466713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 47/91] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/role_assignments?user.id=3f7bbb00e65c4b7393cbc41f848a6216&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:13.467674 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.483355 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:13.510261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7d83a-0391-45b7-b26b-c646f7161e94 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.566350 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.567382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.568273 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.568765 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.569782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:13.570683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.575276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.588403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 45/92] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:13.590899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.677987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada979cd-b5bd-4ff1-8945-eeba1c03d0c9 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.702342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:13.763156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.764271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.764765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.765282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.769076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:13.771059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:13.777136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 48/93] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:13.780947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:13.836139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3323-43be-4b21-8eb1-fb5c9d34b90b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:13.941597 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:13.942270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:13.942546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:13.942821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:13.980991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:14.017043 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1dbf4-5ca2-49cb-b290-f99ade64648a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:14.070090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:14.071044 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:14.071333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:14.071612 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:14.072397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] RBAC: Adding query filter params (role.id=0df241ea8604447fb366198675e1711a, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:14.073929 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:14.075610 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:14.083219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 49/94] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=0df241ea8604447fb366198675e1711a => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:14.108534 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:14.110434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:14.265599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 46/95] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:14.271494 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:14.373281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:14.439211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c1d-5bb8-477a-a5a6-9989dc736709 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:14.478397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:14.479278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:14.479567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:14.479843 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] PATH_INFO: `/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:14.481095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] RBAC: Authorizing `identity:get_project(project_id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:14.482595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51dbc7-63fc-4588-b938-96ca0d949c26 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:14.484373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 50/96] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:14 2022] GET /identity/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:14.490467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:14.551217 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:14.608671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f9f92-fe4e-4210-99f5-7133aa3fc9e1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:14.647041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:14.647703 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:14.648109 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:14.648384 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:14.649528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:14.649938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:14.651929 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38163d4d-2963-43c3-adb7-db7c27fec65d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:14.658918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 47/97] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:14 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:16.776865 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8697c-29d8-4ec5-b5e6-76b5eb82296e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:16.777492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8697c-29d8-4ec5-b5e6-76b5eb82296e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:16.777847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8697c-29d8-4ec5-b5e6-76b5eb82296e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:16.779710 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 51/98] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:16.786181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc24ab-b9bd-4206-b3d4-e61a5b3208c3 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:16.786769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc24ab-b9bd-4206-b3d4-e61a5b3208c3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:16.787395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc24ab-b9bd-4206-b3d4-e61a5b3208c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:16.821094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f2dc24ab-b9bd-4206-b3d4-e61a5b3208c3 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:16.822900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f2dc24ab-b9bd-4206-b3d4-e61a5b3208c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:16.946957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 48/99] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:17.122828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991944-08a2-40f9-b874-fdd9c7a6ae90 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.123191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991944-08a2-40f9-b874-fdd9c7a6ae90 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.123396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991944-08a2-40f9-b874-fdd9c7a6ae90 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.125114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 52/100] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:17.132709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.133095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.133367 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.156290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:17.157640 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:17.161694 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b2a-dc08-47d5-ae2a-edc25d40344b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.162207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b2a-dc08-47d5-ae2a-edc25d40344b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.162950 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b2a-dc08-47d5-ae2a-edc25d40344b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.165600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 53/101] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:17.173026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564aaf-1faa-47a6-9510-45d8122d8a17 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.173351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564aaf-1faa-47a6-9510-45d8122d8a17 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.173582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564aaf-1faa-47a6-9510-45d8122d8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.209474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-8d564aaf-1faa-47a6-9510-45d8122d8a17 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:17.214334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-8d564aaf-1faa-47a6-9510-45d8122d8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:17.244704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:17.350023 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 49/102] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:17.431388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 54/103] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:17.526919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:17.710602 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d023c-402e-4ce8-a7ae-d1384c918052 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:17.762071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19100-abdf-4c5c-ac8e-62d5ff3cef4f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.763105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19100-abdf-4c5c-ac8e-62d5ff3cef4f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.763903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a19100-abdf-4c5c-ac8e-62d5ff3cef4f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.769258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 55/104] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:17.791753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.793140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.795145 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.805515 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727047-2974-4602-a069-85c457684980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:17.806744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727047-2974-4602-a069-85c457684980 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:17.807268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727047-2974-4602-a069-85c457684980 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:17.807787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727047-2974-4602-a069-85c457684980 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:17.842070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727047-2974-4602-a069-85c457684980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:17.849979 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:17.852114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-0b727047-2974-4602-a069-85c457684980 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:17.859393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:17.861233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:17.862682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 50/105] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:17.871745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727047-2974-4602-a069-85c457684980 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.001375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.012324 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.065540 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 56/106] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:18.066450 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.165934 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727047-2974-4602-a069-85c457684980 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.208323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e13781-1da1-4e8b-a2bf-2de2f357663b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.253917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.254829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.255303 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.255642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.278380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.279348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.279772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.280465 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.281637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:18.282109 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:18.284847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:18.285233 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:18.291035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:18.292841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:18.294355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:18.297113 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 57/107] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:18.299118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.311370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 51/108] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:18.312987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.405602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.504511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a9607-c1b9-44f4-bfe9-97e373defbdc None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.546530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.547327 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.547760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.548176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.549556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:18.552064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:18.557269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 58/109] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:18.558591 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.593765 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.601187 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b310-4cb1-412b-8d7d-72d5cdd87bd5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.648994 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.649590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.650176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.650766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.651811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:18.652287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:18.654110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:18.665251 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 52/110] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:18.666344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.738785 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934be5b9-25ef-4503-8051-f1eb4f00a041 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.740533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.781499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.781499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.781499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.781846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] PATH_INFO: `/v3/users/ae4d493f06a145ce8c0d95996febf46b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.796026 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d46f11-63ff-4f49-b3bd-6fb86c6d8408 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.799050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4d493f06a145ce8c0d95996febf46b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:18.800596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:18.802297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 59/111] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/users/ae4d493f06a145ce8c0d95996febf46b => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:18.803082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.837361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.838176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.838454 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.838733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.839391 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:18.840898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b563f2a-ac54-4b50-9b5d-cda40eca1ad3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:18.873508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 53/112] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:18:18 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:18.874802 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f3d2-d4a5-4048-8a99-9cf44c67f618 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.875138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f3d2-d4a5-4048-8a99-9cf44c67f618 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.875342 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f3d2-d4a5-4048-8a99-9cf44c67f618 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.876666 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 54/113] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:18.882317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f3d2-d4a5-4048-8a99-9cf44c67f618 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.898100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.936573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385805-dce5-468d-b4fe-82054ffa0523 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:18.988519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:18.989180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.989459 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.989730 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.003472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5d407618-c977-4b17-858e-c684383e5dbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:19.008221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:19.009207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:19.011137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 60/114] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:19.013505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f929dc-3fc4-49a6-9427-aac5893ad29e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.013505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f929dc-3fc4-49a6-9427-aac5893ad29e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.013505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f929dc-3fc4-49a6-9427-aac5893ad29e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.015169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 61/115] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:19.015911 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f929dc-3fc4-49a6-9427-aac5893ad29e None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.034781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f3d2-d4a5-4048-8a99-9cf44c67f618 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.045491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.081477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.082153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.082427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.082704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.084027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.085533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eebc8-a83b-43a3-9176-68399e3c6e5f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.087477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 55/116] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:19.088551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.088867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.089270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.110309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:19.111576 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:19.191359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f929dc-3fc4-49a6-9427-aac5893ad29e None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.214932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 56/117] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:19.215765 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.238716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.270760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.271407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.271809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.272415 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.380560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc860949-be90-46fe-9e0e-6d0e27a1fa67 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.404631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.406354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.420545 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.421506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.421979 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.422441 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.423322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:19.423838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.425532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a59f0c-cb2d-4477-8755-82415d73e804 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.435698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 57/118] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:19.437308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.437567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.438375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.438899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.461866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:19.463987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:19.547908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 62/119] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:19.547908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.550449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 58/120] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:19.551584 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.556181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.672581 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a341b-d5ca-48aa-8fe4-e27cb81119ac None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.691384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83809ad-d695-4dae-9747-3aa954cd2442 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.722411 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.723974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.724553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.725181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.727486 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.733087 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.735800 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.739018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 59/121] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:19.740357 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.747246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.747984 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.748270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.748545 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.749736 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.751235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.753450 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 63/122] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:19.754519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.829653 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.872352 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ba6e-6e0f-40ce-89ec-fc3f37b334ba None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.897811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96477a02-59d6-4930-9b6f-e680b560e414 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.939732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.941295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.942186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.942933 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.945630 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.948841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.952335 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 60/123] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:19.954526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:19.964682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.965700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.966178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.966649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.987119 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:19.997308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:19.998981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:20.000656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 64/124] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:20.003811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.099291 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.157989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f45a77-9566-4230-8f78-6a3425b4808f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.191766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2afab-9945-4724-a924-c30494d705db None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.210053 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.210875 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.211196 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.211485 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.213785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.215790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.218234 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 61/125] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:19 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:20.218987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.231434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.260118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.261268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.261767 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.262380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/users/b713114121954f8e943dfa1ab5edec54/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.265898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, user_id=b713114121954f8e943dfa1ab5edec54, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.268778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.315914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 65/126] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:19 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/users/b713114121954f8e943dfa1ab5edec54/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:20.315914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.405965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf755d-524a-467e-a028-4a3591059519 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.466556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.468065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.468928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.469660 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.471275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=ae4d493f06a145ce8c0d95996febf46b) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:20.472453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.475786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.484071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443ddd-a978-4d49-afe6-dc67b711a845 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.496624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 62/127] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/role_assignments?user.id=ae4d493f06a145ce8c0d95996febf46b&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=28a42604da0d480ba626975b5697b7a2 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:20.497828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.500780 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.535089 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.535859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.536283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.536574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.537372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:20.537705 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.539242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.550358 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 66/128] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:20.551258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.672843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.687965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372202-cf49-494e-9fd9-ccbc9b3c7c67 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.731838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.732846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.733234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.733620 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/users/3f7bbb00e65c4b7393cbc41f848a6216/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.736903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, user_id=3f7bbb00e65c4b7393cbc41f848a6216, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.738534 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.743193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447820-d1a6-4a79-afcd-83157ace78cb None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.759133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 67/129] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:20 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/users/3f7bbb00e65c4b7393cbc41f848a6216/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:20.764194 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.826337 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.827759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.830079 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.831050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.848656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.873202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:20.883683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:20.885336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:20.886781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 63/130] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:20.900346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:21.094396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294cf7-10bd-4311-bf88-c9bcc7c915b5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.122470 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45531f-c1b2-42db-a23b-516a0e6fe275 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.172454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.173284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.173670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.173954 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.175333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.176989 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.178778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 68/131] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:21.180822 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:21.187281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:21.197133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.197995 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.198448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.201906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.202808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:21.203182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.205068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.230635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 64/132] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:21.240027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:21.386288 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:21.394288 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a77e-f23b-4a40-8ea3-78e7d6d674fb None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.448774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.449744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.450170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.450709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] PATH_INFO: `/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.452392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] RBAC: Authorizing `identity:get_project(project_id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.454405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.461774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 69/133] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:21 2022] GET /identity/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3 => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:21.473140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:21.517447 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc9fc-dd9c-42d0-8013-74c6165f341e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.614786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.615903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.616423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.617152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.619179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.622952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.626475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 65/134] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:21 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:21.649423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:21.678207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe781f4-d0eb-4371-bc06-f55a8d4f600a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.751761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.752792 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.753251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.753695 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] PATH_INFO: `/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3/users/b713114121954f8e943dfa1ab5edec54/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.756143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3, user_id=b713114121954f8e943dfa1ab5edec54, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.757846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.781292 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 70/135] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:21 2022] PUT /identity/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3/users/b713114121954f8e943dfa1ab5edec54/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:21.824564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:21.892308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216561-1bc0-4f48-9845-d5def93a47e1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:21.952410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:21.954152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.954722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.955229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.957246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:21.959229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f45b0-db3f-4472-ab11-2c9a514410a9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:21.961832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 66/136] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:21 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:21.969592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:22.006801 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:22.065892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0d7e-42ed-4ff1-aecd-df4f025668ef None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:22.066523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0d7e-42ed-4ff1-aecd-df4f025668ef None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:22.067023 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0d7e-42ed-4ff1-aecd-df4f025668ef None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:22.069183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 67/137] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:22.077183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:22.077810 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:22.078653 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:22.113873 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:22.122369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:22.140057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c022-a337-49a1-9273-ece1c2b6e410 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:22.227802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:22.230339 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:22.231744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:22.232293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/users/b713114121954f8e943dfa1ab5edec54/roles/0df241ea8604447fb366198675e1711a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:22.238281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, user_id=b713114121954f8e943dfa1ab5edec54, role_id=0df241ea8604447fb366198675e1711a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:22.242338 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:22.274442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 71/138] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:21 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/users/b713114121954f8e943dfa1ab5edec54/roles/0df241ea8604447fb366198675e1711a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:18:22.312120 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 68/139] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:23.105000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:23.247238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:23.273891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ee8b-b041-4887-a9af-78decc1aca44 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:23.333785 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:23.334516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:23.334813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:23.335097 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:23.340790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:23.342323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313a6e-422b-4022-9686-50cd996b2f37 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:23.344274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 72/140] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:23.353255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:23.462213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:23.528905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c71e8-31c6-4de3-833d-32f60ec725bf None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:23.596073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:23.596708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:23.597006 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:23.597296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:23.598070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:23.599583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ab221-6c82-45b9-a18e-e45923628ab3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:23.640558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 69/141] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:23 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:24.696829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f2e-a0ad-420c-b6c7-d8758f9b2d5d None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:24.698346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f2e-a0ad-420c-b6c7-d8758f9b2d5d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:24.698906 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f2e-a0ad-420c-b6c7-d8758f9b2d5d None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:24.701796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 73/142] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:24.713753 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8136fc-9bec-4eae-a069-65713e88068f None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:24.714474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8136fc-9bec-4eae-a069-65713e88068f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:24.714771 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8136fc-9bec-4eae-a069-65713e88068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:24.762215 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ad8136fc-9bec-4eae-a069-65713e88068f None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:24.766937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ad8136fc-9bec-4eae-a069-65713e88068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:24.943554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 70/143] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:25.163220 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c2b8-1afe-42fd-ab31-3c90226c7777 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:25.163713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c2b8-1afe-42fd-ab31-3c90226c7777 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:25.164238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4c2b8-1afe-42fd-ab31-3c90226c7777 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.166829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 74/144] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:25.174295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3a6b-a1be-45f3-8652-4220ecb3db8c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:25.174783 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3a6b-a1be-45f3-8652-4220ecb3db8c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:25.175262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3a6b-a1be-45f3-8652-4220ecb3db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.217726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-a5fa3a6b-a1be-45f3-8652-4220ecb3db8c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:25.219794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-a5fa3a6b-a1be-45f3-8652-4220ecb3db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:25.322717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:25.371619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 71/145] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:25.509710 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6da-f95b-4054-85e3-7a7f89d8e644 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:25.510433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6da-f95b-4054-85e3-7a7f89d8e644 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:25.510433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4e6da-f95b-4054-85e3-7a7f89d8e644 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.511645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 75/146] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:18:25.517724 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:25.517998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:25.518273 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.549206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:25.551280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:25.661282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 72/147] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:25.813521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e6da-f95b-4054-85e3-7a7f89d8e644 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:25.962269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4e6da-f95b-4054-85e3-7a7f89d8e644 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:26.013190 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:26.014036 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.014318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.014589 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.034630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:26.040898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:26.046498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:26.049816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 76/148] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:26.052448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.203516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82740d82-23a4-4072-86d3-fcb23e9c62e6 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:26.206421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:26.255617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:26.256316 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.256592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.256860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.257552 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:26.257916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:26.259538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:26.271893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 73/149] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:26.282446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.304507 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:26.379471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.448800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834689-1a26-4abc-9862-bd08a976e380 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:26.544264 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:26.544833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.545109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.545383 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.546640 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:26.548192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:26.550082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 77/150] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:26.556463 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.608053 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ad9f-7c4e-4394-b8bc-538bb1d291c9 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:26.662354 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:26.663132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.663464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.663807 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.703137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:26.722296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:26.725012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:26.727743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 74/151] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:26.739098 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.796224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:26.839070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:26.862514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bf7c0-86ab-4779-a51b-83e52d03ff4e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:26.955079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:26.956921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.959000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.959530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.027374 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14795cb9-3af9-465e-bd40-6607c77df883 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:27.099180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:27.100737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.100737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.104257 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.104257 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:27.104257 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:27.105941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:27.125381 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 75/152] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:27.127198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:27.170319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:27.173262 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:27.319930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:27.340753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:27.346958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a8171-1526-443b-ae2d-34bf7377183e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:27.376306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 78/153] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:18:27.377527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:27.422989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:27.424371 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.425114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.425870 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.446044 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-07dbfaa9-deb3-4418-9517-adce5bba3844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:27.456442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:27.457967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:27.459671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:27.464211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 76/154] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:27.466912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91aac-cc44-4e08-a5df-af93869380c0 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.467772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91aac-cc44-4e08-a5df-af93869380c0 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.468628 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91aac-cc44-4e08-a5df-af93869380c0 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.471741 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 77/155] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:27.473713 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91aac-cc44-4e08-a5df-af93869380c0 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:27.615914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307379ba-d071-4f05-961b-2cdd115836b3 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:27.711491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:27.712478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.712883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.713371 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] PATH_INFO: `/v3/users/ae4d493f06a145ce8c0d95996febf46b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.720843 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] RBAC: Authorizing `identity:get_user(user_id=ae4d493f06a145ce8c0d95996febf46b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:27.722040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91aac-cc44-4e08-a5df-af93869380c0 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:27.722650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:27.724769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 79/156] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:27 2022] GET /identity/v3/users/ae4d493f06a145ce8c0d95996febf46b => generated 289 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:27.725722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:27.814369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:27.815610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.816164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.816614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.819362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:27.823506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2b06-9caf-457c-8799-3bc785b55f5d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:27.827014 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 78/157] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:27 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:27.829597 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0fd-1993-4d91-82d4-47c07b00e64b None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.830093 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0fd-1993-4d91-82d4-47c07b00e64b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.830580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e0fd-1993-4d91-82d4-47c07b00e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.865399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-fa37e0fd-1993-4d91-82d4-47c07b00e64b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:27.867732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-fa37e0fd-1993-4d91-82d4-47c07b00e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:27.870869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:27.896380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:27.975997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 79/158] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:27.977235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e4b4-c364-444e-87b0-febdcbec9f9a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.977517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e4b4-c364-444e-87b0-febdcbec9f9a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.977840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e4b4-c364-444e-87b0-febdcbec9f9a None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.980212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 80/159] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:27.980821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e4b4-c364-444e-87b0-febdcbec9f9a None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.022219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253a807-6de3-4798-b624-826dacc0975f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.063337 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.064415 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.065226 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.065783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.066922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:28.067490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.069326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.080198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 80/160] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:28.081459 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.226190 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e4b4-c364-444e-87b0-febdcbec9f9a None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.303684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a0d0-2d7a-43b1-a77f-a11ef79d0a50 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.316443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.317094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.317366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.317632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.325016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.326604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5166d-f4bc-42cd-9be4-d3d64f00a36c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.328786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 81/161] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:27 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:28.330144 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.330422 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.330694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.334070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.363402 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.364348 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.364839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.365649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.366840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:28.367345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.369344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.376768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 81/162] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:28.377918 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.383532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:28.383532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:28.406397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.547071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 82/163] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:28.548960 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.630844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07eda-cc6b-4d39-afea-6daca9004da2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.724969 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.725627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.725945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.726219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] PATH_INFO: `/v3/users/3f7bbb00e65c4b7393cbc41f848a6216` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.727442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] RBAC: Authorizing `identity:get_user(user_id=3f7bbb00e65c4b7393cbc41f848a6216)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.729299 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.731734 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 82/164] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/users/3f7bbb00e65c4b7393cbc41f848a6216 => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:28.733095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.806057 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe915-920e-46ad-84cc-442bdc128d8c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.862916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.876883 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.877635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.877941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.878332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/users/ae4d493f06a145ce8c0d95996febf46b/roles/28a42604da0d480ba626975b5697b7a2` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.883909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, user_id=ae4d493f06a145ce8c0d95996febf46b, role_id=28a42604da0d480ba626975b5697b7a2)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.883909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.911427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 83/165] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:28 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/users/ae4d493f06a145ce8c0d95996febf46b/roles/28a42604da0d480ba626975b5697b7a2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:28.912663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.921207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.042831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc131c-cb8e-4580-9ec3-a4e67585bf4d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.115754 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.116755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.117044 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.117347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.149126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:29.155232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:29.156223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:29.157041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:29.160933 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 83/166] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:29.167957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:29.190309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c33e36-0917-4f0b-9844-10d39fb6faef None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.284277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.284930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.285203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.285459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.392838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ee13b-9720-480d-837e-dd6aef1458c0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.404517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.443389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:29.445517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:29.460369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.471347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.476687 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.477385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.478050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.479060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:29.479596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:29.481574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:29.507744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 84/167] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:29.508791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:29.651345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 84/168] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:29.652918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:29.753248 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc049891-ae71-4c0c-98b7-ce1eea78e81e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.808731 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.809495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.809951 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.810271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.837375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d69c49-6d3f-4fcf-9aa7-a40d3de6cda4 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.867578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-a7525041-4431-4b6e-9c22-e513bab3b223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:29.873099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:29.874042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:29.875243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 85/169] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:29.876003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b57-60ca-42ed-b8b0-fdb71b829743 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.876307 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b57-60ca-42ed-b8b0-fdb71b829743 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.876454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9b57-60ca-42ed-b8b0-fdb71b829743 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.877821 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 86/170] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:29.878908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9b57-60ca-42ed-b8b0-fdb71b829743 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:29.880589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.914226 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.934843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.935968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.936436 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.936881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.939144 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:29.942372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:29.945816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 85/171] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:29.947312 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.065361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b9b57-60ca-42ed-b8b0-fdb71b829743 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.111176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afc983-4e9e-41d0-9ee0-f5450e41d2c1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.115385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.116108 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.116390 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.116664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.118134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.122144 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692020b-7e52-4697-b75b-f8a75e26cc3e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.124778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 87/172] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:30.126184 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb266-1a31-4013-9883-e73a35dfff7f None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.126475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb266-1a31-4013-9883-e73a35dfff7f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.126743 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdb266-1a31-4013-9883-e73a35dfff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.157876 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-37bdb266-1a31-4013-9883-e73a35dfff7f None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:30.160090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-37bdb266-1a31-4013-9883-e73a35dfff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:30.163715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.164464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.164686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.164951 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.165956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:30.166277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.168077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.180188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 86/173] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:30.181707 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.238559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:30.266577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 88/174] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:30.266577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2df4-7b1a-4576-837e-d6935a69ad5d None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.266577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2df4-7b1a-4576-837e-d6935a69ad5d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.266577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2df4-7b1a-4576-837e-d6935a69ad5d None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.266577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 89/175] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:30.267311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2df4-7b1a-4576-837e-d6935a69ad5d None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.345793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:30.396568 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fbf4-b635-434f-b5e0-9ccc41678b87 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.438590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.439289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.439692 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.440111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.458536 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2df4-7b1a-4576-837e-d6935a69ad5d None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.499952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.500829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.501457 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.501966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.502938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=3f7bbb00e65c4b7393cbc41f848a6216) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:30.503424 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.505141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.520033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 90/176] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/role_assignments?user.id=3f7bbb00e65c4b7393cbc41f848a6216&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:30.521455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.535917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.535917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830a6e7-ef03-4986-8f82-23eef39291c9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.574526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:30.668396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 87/177] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:30.669993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798881-aa5d-44b8-bc5b-99719f7ec07d None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.670286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798881-aa5d-44b8-bc5b-99719f7ec07d None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.670558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e798881-aa5d-44b8-bc5b-99719f7ec07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.692952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0e798881-aa5d-44b8-bc5b-99719f7ec07d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:30.695038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0e798881-aa5d-44b8-bc5b-99719f7ec07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:30.833101 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:30.859522 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808114c3-1a58-4ac7-9e0a-2effc1f85588 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.866195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 88/178] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:30.868110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3055d-19c3-4944-b884-2c8b0a058b37 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.868703 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3055d-19c3-4944-b884-2c8b0a058b37 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.869345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3055d-19c3-4944-b884-2c8b0a058b37 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.870988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 89/179] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:30.872000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3055d-19c3-4944-b884-2c8b0a058b37 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.941825 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.944312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.944787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.945255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] PATH_INFO: `/v3/users/b713114121954f8e943dfa1ab5edec54` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.948059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] RBAC: Authorizing `identity:get_user(user_id=b713114121954f8e943dfa1ab5edec54)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.951083 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.954682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 91/180] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/users/b713114121954f8e943dfa1ab5edec54 => generated 275 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:30.961444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.974901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.061528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3055d-19c3-4944-b884-2c8b0a058b37 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.112099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db04412-16d4-4ef3-b4b0-b2aed6808f8c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.116151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.117117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.117630 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.118137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.119920 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:31.122970 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31adcdc-5959-4062-aeac-ff4730246bdf None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:31.126218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 90/181] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:31.128673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.129257 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.130039 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.168801 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.169614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.169877 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.170196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.173730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:31.176509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:31.189571 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:31.195373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:31.197228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 92/182] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:31.198753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.226552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.364581 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 91/183] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:31.366579 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.374065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929b0c-e88e-442f-9b6b-8ad8f8865351 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.452374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.453453 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.453825 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.454189 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.504641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.554899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41920-99a0-4fc5-8364-699c9206d331 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.557752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:31.559475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:31.585106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.602117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.603199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.603629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.604102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.605058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] RBAC: Adding query filter params (role.id=0df241ea8604447fb366198675e1711a, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:31.605513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:31.607379 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:31.614775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 92/184] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=0df241ea8604447fb366198675e1711a => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:31.615956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.763906 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 93/185] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:31.768190 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890a88c-4e3f-4ad8-9dc9-fc48a47359d1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.770355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.823211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.840317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.842430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.843323 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.844186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.845927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:31.846648 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:31.848439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:31.861110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 93/186] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:31.862694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.996839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1bef2-9bca-43ef-a7b0-2541301c911a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.034987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:32.056339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad247a-e167-421f-a49e-3b067deff161 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.062616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.063277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.063623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.063945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.081879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:32.089454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:32.090965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:32.093182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:32.094876 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 94/187] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:32.097078 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.112599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.113298 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.113731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.114026 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] PATH_INFO: `/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.115850 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.117708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.120763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 94/188] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/projects/c3e1aaf5f3a84fbeb9cf9d8d665f81b3 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:32.130621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.236359 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:32.270646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8fd-5b60-433f-b706-16775e2b0103 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.324866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285da9d-84f9-4580-8e5d-737e898571a3 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.331974 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.332712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.333013 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.333360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.336244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.337533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.339360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 95/189] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:32.344217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.379459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.380138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.380414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.380683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.404064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.406391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:32.406799 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.409700 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 95/190] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:32.413522 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.495155 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca39e33-df8b-45ed-ae3b-c336812dcc33 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.552537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.553087 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.553359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.553632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.554321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:32.554625 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.556185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166bc3e-1558-44ec-a229-75194acd61c5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.565734 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 96/191] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:32.570472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45037f-9e1c-4364-bfe7-ce5bbc097d1e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.570472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45037f-9e1c-4364-bfe7-ce5bbc097d1e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.570472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45037f-9e1c-4364-bfe7-ce5bbc097d1e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.570472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 97/192] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:32.570472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45037f-9e1c-4364-bfe7-ce5bbc097d1e None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.589550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa49ea-6a7a-41c8-91c2-78d4f0d95f8a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.608150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:32.648505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.649756 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.650273 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.650934 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.653361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3, user.id=b713114121954f8e943dfa1ab5edec54) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:32.653361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.656136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.680192 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 96/193] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/role_assignments?user.id=b713114121954f8e943dfa1ab5edec54&scope.project.id=c3e1aaf5f3a84fbeb9cf9d8d665f81b3&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:32.680192 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.769537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45037f-9e1c-4364-bfe7-ce5bbc097d1e None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.790398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:32.829650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b727-0846-4393-bf5c-65fd1c95c539 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:32.839619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.839846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.840187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.840604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:32.841657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:32.844164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:32.879946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 98/194] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:32 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:32.879946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:32.923749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:32.925337 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:32.926050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:32.926827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.018150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.050852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fffc6-821a-4943-a0ca-0851a42b47d5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:33.055997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:33.058694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:33.114973 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:33.115968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.116441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.116917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.118925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:33.121563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41620-288d-4152-b00b-f6d034c25fd3 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:33.124523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 99/195] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:33.127927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.127927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.127927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.147552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:33.149235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:33.179421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.230719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 97/196] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:33.233456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:33.243385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 100/197] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:33.244349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:33.388521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.429471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d6d0-b23c-4817-9965-6d73eef984e4 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:33.439833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026228-11ab-422a-bea7-cf365e8341d2 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:33.496451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:33.497403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.497845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.498311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.499721 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:33.501564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:33.503687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:33.504055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 101/198] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:33.504568 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.504918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.505302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.513072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:33.576256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.638973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:33.642295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:33.700471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7a639-6b60-4789-bcf6-1df99ebc565a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:33.752585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:33.753216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.753494 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.753778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.754531 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=48beb5c5df594256b31016cca9c50031) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:33.755249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:33.756489 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:33.757766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.764178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 102/199] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3/role_assignments?user.id=48beb5c5df594256b31016cca9c50031&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:33.786051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:33.794319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 98/200] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:33.802525 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:33.967942 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f9b2-b4de-4e33-a338-045afa39b424 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.010462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.011469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.011971 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.012431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.013139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:34.015388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:34.017589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:34.019774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 99/201] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:34.027489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:34.034422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8772a-bb3b-4f6a-a4a1-72f7e44e42ee None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.094440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.095441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.095938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.096452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.111414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:34.120127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:34.121088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:34.121873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:34.124493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 103/202] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:34.137945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:34.171204 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:34.297702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f8b-d402-47b6-bd94-e339c3cce1f0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.388230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.388866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.391590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6fdc-90c0-4343-8a6a-586130a93181 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.393177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.393575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.394376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] RBAC: Adding query filter params (role.id=0df241ea8604447fb366198675e1711a, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=48beb5c5df594256b31016cca9c50031) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:34.394688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:34.396234 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:34.410767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 100/203] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:34 2022] GET /identity/v3/role_assignments?user.id=48beb5c5df594256b31016cca9c50031&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=0df241ea8604447fb366198675e1711a => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:34.448381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.449062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.449313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.449588 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.450296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:34.450607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:34.452092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:34.471068 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 104/204] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:34.480328 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:34.706720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a1e-c252-41d1-b905-3dd4a3f33a4e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.728272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:34.772910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.773993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.774497 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.774978 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] PATH_INFO: `/v3/users/ae4d493f06a145ce8c0d95996febf46b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.778538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4d493f06a145ce8c0d95996febf46b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:34.781339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:34.784200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 101/205] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:34 2022] GET /identity/v3/users/ae4d493f06a145ce8c0d95996febf46b => generated 289 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:34.790338 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:34.825344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:35.002062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c27-8909-49e8-87a0-5ccd1431a938 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:35.058761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:35.059416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:35.059689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:35.059977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:35.180225 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:35.182098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:35.209511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:35.417691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 105/206] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:35.426020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:35.601394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2a77-d1a7-496a-9add-e130456c8408 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:35.648356 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:35.650130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:35.650887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:35.651416 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:35.653408 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:35.655831 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0100d-cc34-4d24-befd-668dcfe86897 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:35.659613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 102/207] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:35 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:35.667912 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:35.825799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65132-1a1b-4b33-8f51-0fb5937527ac None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:35.850162 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:35.880813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:35.881397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:35.881777 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:35.882051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:35.882804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, scope.project.id=7876a52b82454de19a81f60278c91be6, user.id=ae4d493f06a145ce8c0d95996febf46b) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:35.883107 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:35.884978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5d25a-d6a1-477e-99d4-1c8b04558f92 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:35.896933 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 106/208] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:35 2022] GET /identity/v3/role_assignments?user.id=ae4d493f06a145ce8c0d95996febf46b&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=28a42604da0d480ba626975b5697b7a2 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:36.354278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35490e-de31-4502-a7d2-689f7bc6c996 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.354935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35490e-de31-4502-a7d2-689f7bc6c996 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.354935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35490e-de31-4502-a7d2-689f7bc6c996 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.356564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 103/209] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:36.363408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f7f0-b74f-460a-82d2-fb6934ed7fc9 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.364256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f7f0-b74f-460a-82d2-fb6934ed7fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.364732 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074f7f0-b74f-460a-82d2-fb6934ed7fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.374724 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b137-574d-4c14-b1c9-b629088ba4af None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.375331 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b137-574d-4c14-b1c9-b629088ba4af None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.375822 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b137-574d-4c14-b1c9-b629088ba4af None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.377458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 104/210] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:18:36.385783 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd429b9-b8bb-4a19-b8ed-dfd31784a12c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.386044 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd429b9-b8bb-4a19-b8ed-dfd31784a12c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.386335 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd429b9-b8bb-4a19-b8ed-dfd31784a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.396462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9074f7f0-b74f-460a-82d2-fb6934ed7fc9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:36.398072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9074f7f0-b74f-460a-82d2-fb6934ed7fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:36.409243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-1cd429b9-b8bb-4a19-b8ed-dfd31784a12c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:36.410534 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-1cd429b9-b8bb-4a19-b8ed-dfd31784a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:36.491680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:36.506992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 107/211] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:36.542194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 105/212] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:36.792456 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498369-35cb-4af2-a5e7-273b9dc94f2e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.792982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498369-35cb-4af2-a5e7-273b9dc94f2e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.792982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18498369-35cb-4af2-a5e7-273b9dc94f2e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.794314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 108/213] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:36.800619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.801242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.801733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.823933 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:36.825553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:36.922346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18498369-35cb-4af2-a5e7-273b9dc94f2e None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:36.935979 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 106/214] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:37.084380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18498369-35cb-4af2-a5e7-273b9dc94f2e None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.096926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.131624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.140795 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.141913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.142397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.142879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.168050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:37.178840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:37.179829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:37.181357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 109/215] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:37.190624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.329727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca785ad-9ecc-4bd5-a43e-0a53c3d8f887 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.343227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.411413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.412752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.413097 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.413685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.416244 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:37.418901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3491e-22fd-4861-9896-23fc658f45f1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.419136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:37.422910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 107/216] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:37.424144 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.472834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.473478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.473757 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.474156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.475062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:37.475381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:37.476888 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:37.492003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 110/217] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:37.492003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.537694 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.647896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802f3f-8cad-44b4-aa28-a83f9039a7a1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.672221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897fbe-7412-4d7e-b473-4ea608144c63 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.717223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.718155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.718529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.718920 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.733654 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:37.739651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:37.741812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:37.743526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 108/218] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:37.744596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.754753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.755715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.756216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.756653 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.757749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:37.760468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:37.792991 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 111/219] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:37 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:37.794584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.843903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.968215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.975138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f814d-75d2-4643-a2e4-caf27aaf6dff None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.011497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e342a38-4484-4c2c-86d3-6f4d23dc2776 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.038183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.039145 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.039571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.040319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] PATH_INFO: `/v3/users/a6785b6be1b94832a816c21fc52a24fc` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.070035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] RBAC: Authorizing `identity:get_user(user_id=a6785b6be1b94832a816c21fc52a24fc)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.073079 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.081270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 109/220] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/users/a6785b6be1b94832a816c21fc52a24fc => generated 297 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:38.084708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:38.086506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.087685 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.088207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.088680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.089758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:38.090410 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.092921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.115333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 112/221] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:38.118388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:38.228826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:38.249362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8a8f-9d01-4ca6-b514-99d54838a651 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.339292 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adebaf8-5973-4349-8a0c-1c5817e999c6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.341474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.341474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.341474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.341889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.414171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.415007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.415205 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.415666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.418377 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.418859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83df1ff-651f-4306-afcf-1be64aa7bb8f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.423926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 113/222] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:38 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:38.424115 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69359-9e7b-4abb-bc8c-5a3da927897b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.426650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69359-9e7b-4abb-bc8c-5a3da927897b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.426650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69359-9e7b-4abb-bc8c-5a3da927897b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.427703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 114/223] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:38.429529 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69359-9e7b-4abb-bc8c-5a3da927897b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:38.470552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:38.481902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.484952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a2e3-0b21-41e9-b0be-31cafcf05b14 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.631604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69359-9e7b-4abb-bc8c-5a3da927897b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.632861 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:38.656251 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 110/224] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:18:38.658708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.659178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.659644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.693442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:38.694020 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.695643 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:38.696436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.697234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.698062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.699721 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.701655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.704505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 115/225] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:38 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:38.712232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:38.844588 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:38.850194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 111/226] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:38.852148 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:38.870637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555a167-f8b2-40dd-a676-0e74e72b35d8 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:38.985926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:38.986959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:38.987445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:38.987977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:38.991383 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:38.993378 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:38.995464 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 116/227] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:38 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:39.005181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:39.116417 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3c46d-8e4d-4b45-9831-bec2b51914bc None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:39.144973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:39.160231 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:39.160963 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.161240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.161518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/48beb5c5df594256b31016cca9c50031/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.163834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, user_id=48beb5c5df594256b31016cca9c50031, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:39.165828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:39.192970 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 112/228] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:38 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/48beb5c5df594256b31016cca9c50031/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:39.241474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d3e-321f-4f7e-a2f4-d44e988bdf2d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:39.270931 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:39.320560 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:39.321572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.322040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.322491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.329857 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=a6785b6be1b94832a816c21fc52a24fc) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:39.330302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:39.332309 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:39.348842 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 117/229] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:39 2022] GET /identity/v3/role_assignments?user.id=a6785b6be1b94832a816c21fc52a24fc&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:39.433446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88aee-c444-42ae-8104-66a470224dc8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:39.492178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:39.493209 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.493209 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.493466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.515924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:39.521005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:39.522750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:39.523843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 113/230] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:39.532118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:39.579632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:39.722317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5f32-05cd-41ef-94d6-9a61bf81c5e9 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:39.781494 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:39.782142 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.782426 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.782701 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.783419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:39.783760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:39.785248 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:39.800704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 118/231] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:39.807064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:39.905672 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:40.014252 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d105a4-0219-406d-9f60-33900f0ab32e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:40.075048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:40.076121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.076604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.077071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.079465 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:40.082339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:40.085358 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 114/232] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:39 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:40.094440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:40.281526 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:40.338682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c9937-1259-44d0-b8f9-14ec634f4711 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:40.400892 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:40.401565 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.401850 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.402126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.403358 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:40.404884 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db79f7b-618a-4b85-b14f-53751f554a66 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:40.411314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 119/233] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:40 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:40.412617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:40.580336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1fbd-af09-430d-9b79-236b19ab11c8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:40.595641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:40.626858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:40.627526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.627805 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.628111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/48beb5c5df594256b31016cca9c50031/roles/0df241ea8604447fb366198675e1711a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.630429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, user_id=48beb5c5df594256b31016cca9c50031, role_id=0df241ea8604447fb366198675e1711a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:40.631953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2514da-d905-457e-bf54-47671c4d543e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:40.658929 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 115/234] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:40 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/48beb5c5df594256b31016cca9c50031/roles/0df241ea8604447fb366198675e1711a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:40.858813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3bfe-83cb-4db6-83d9-1928a7c38f3c None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.859434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3bfe-83cb-4db6-83d9-1928a7c38f3c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.859791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f3bfe-83cb-4db6-83d9-1928a7c38f3c None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.862742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 120/235] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:40.868791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876f83-ade5-4d8a-9ca9-aa668e82cdc7 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.868961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876f83-ade5-4d8a-9ca9-aa668e82cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.869209 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876f83-ade5-4d8a-9ca9-aa668e82cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.892365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-7f876f83-ade5-4d8a-9ca9-aa668e82cdc7 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:40.893578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-7f876f83-ade5-4d8a-9ca9-aa668e82cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:40.973797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 116/236] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:41.364157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f3bfe-83cb-4db6-83d9-1928a7c38f3c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:41.492351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ada5-5c08-4569-a983-f2d10351de08 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.492629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ada5-5c08-4569-a983-f2d10351de08 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.492949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ada5-5c08-4569-a983-f2d10351de08 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.494624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 117/237] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:41.510553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.511287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.511755 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.513868 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f3bfe-83cb-4db6-83d9-1928a7c38f3c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:41.537601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:41.540013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:41.573988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:41.574555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.574840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.575121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.601562 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:41.611502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:41.612919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:41.613683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:41.618497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 121/238] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:41.623529 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:41.648283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:41.669685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 118/239] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:41.757519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65b7b-e6ee-40d3-95aa-5700826890ed None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:41.808281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:41.808925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.809207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.809476 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.810151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:41.810447 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:41.811861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:41.822774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 122/240] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:41.829129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:41.874794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:41.973469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bad15-c786-4914-bef9-269178bc1b54 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.032891 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.033553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.033834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.034107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] PATH_INFO: `/v3/users/971049d98edb4ce680a40259c2052506` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.049739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] RBAC: Authorizing `identity:get_user(user_id=971049d98edb4ce680a40259c2052506)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.051198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.053300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 119/241] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:41 2022] GET /identity/v3/users/971049d98edb4ce680a40259c2052506 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:42.066373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:42.196135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:42.204052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:42.287226 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939044-fb9b-442a-a4b7-8ecf864fa439 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.400274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:42.420644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.421374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.421539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.425511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.429840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de93f-f772-44cc-803c-dcdf314376a4 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.546554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.547108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.547378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.547641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.552451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.553952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c976b-bd7a-4b59-835b-3356372c9f17 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.555927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 120/242] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:42.562337 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f74c-2b4c-4bef-b46c-0a3d34e7b27b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.562682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f74c-2b4c-4bef-b46c-0a3d34e7b27b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.562886 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f74c-2b4c-4bef-b46c-0a3d34e7b27b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.564616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 121/243] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:42.565420 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f74c-2b4c-4bef-b46c-0a3d34e7b27b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:42.592760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.594737 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0fc99-d02b-4772-814b-5cf456d5d484 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.668326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:42.678507 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f74c-2b4c-4bef-b46c-0a3d34e7b27b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.712131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 123/244] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:42.713558 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c25ec-f8d6-45ed-af97-b02326b6fb2f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.713905 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c25ec-f8d6-45ed-af97-b02326b6fb2f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.714264 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c25ec-f8d6-45ed-af97-b02326b6fb2f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.715578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 124/245] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:42.720753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea0e0-7fd1-449b-95c4-5e22b6d46993 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.720753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea0e0-7fd1-449b-95c4-5e22b6d46993 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.720753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ea0e0-7fd1-449b-95c4-5e22b6d46993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.726256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.726887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.727351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.727691 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.728389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.729875 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.738602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-587ea0e0-7fd1-449b-95c4-5e22b6d46993 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:42.740013 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-587ea0e0-7fd1-449b-95c4-5e22b6d46993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:42.758361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 122/246] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:42 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:42.759530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:42.778503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:42.901157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 125/247] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:42.903709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.903709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.903709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.909901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f9763-3593-4b52-adab-ef913ba6af03 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.943301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:42.944594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:42.990528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.991189 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.991471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.991761 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.995660 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.998027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.999909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 123/248] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:42 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:43.006509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.037411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 126/249] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:43.098630 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:43.122990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb16e-63b8-4e32-ba32-7cd2463a728f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.164507 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.165486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.165486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.165834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.166533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=971049d98edb4ce680a40259c2052506) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:43.166845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:43.168344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:43.174795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 124/250] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/role_assignments?user.id=971049d98edb4ce680a40259c2052506&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=28a42604da0d480ba626975b5697b7a2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:43.358322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.403911 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:43.452127 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.497508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348c0-0784-4007-ae89-1eccd2f2729a None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.541345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.542398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.542889 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.543363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.557016 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:43.562488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:43.563442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:43.564306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:43.571345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 127/251] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:43.574459 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.610892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fd39-e28b-4d6d-9c08-707b649992e0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.651744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.652616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.652797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.653061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.668689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:43.672541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:43.673471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:43.674736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 125/252] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:43.693132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.698765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:43.701281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:43.718491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce2e1f-f6e4-458e-a01a-949b309ccb64 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.803039 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.803967 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.804392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.804835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.806099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:43.806627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:43.808360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459dd03-218a-4c49-8f80-b6ff679b93b7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:43.828081 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 128/253] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:43.829723 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099cfaa-eb82-4c87-9cc8-5fbf9a654296 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.830198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099cfaa-eb82-4c87-9cc8-5fbf9a654296 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.830611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099cfaa-eb82-4c87-9cc8-5fbf9a654296 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.832161 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 129/254] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:43.836666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099cfaa-eb82-4c87-9cc8-5fbf9a654296 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.840332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972468df-8929-4a3e-9b8d-4b5dfddf7be6 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.904633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.905270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.905568 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.905864 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.906603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:43.906937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:43.908471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39505d-0d77-4c0b-9f9b-7624d4ce93fc None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:43.930436 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 126/255] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:43.931958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.932269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.932573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.974461 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:43.975614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:44.102460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099cfaa-eb82-4c87-9cc8-5fbf9a654296 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:44.166182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:44.196676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 127/256] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:44.197796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:44.207336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:44.209136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:44.209941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:44.210751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] PATH_INFO: `/v3/users/a6785b6be1b94832a816c21fc52a24fc` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:44.213517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] RBAC: Authorizing `identity:get_user(user_id=a6785b6be1b94832a816c21fc52a24fc)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:44.217076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:44.221114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 130/257] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/users/a6785b6be1b94832a816c21fc52a24fc => generated 297 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:44.232064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:44.320297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:44.566667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e313aa2-cd7c-4bb0-aff9-1905c4e5a018 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:44.601935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d93a6-95b4-4aa5-b8e9-837c814a2a9f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:44.628532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:44.629569 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:44.630026 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:44.630476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:44.637306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:44.639965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:44.642944 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 128/258] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:44 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:44.657639 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:44.770915 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:44.772005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:44.772486 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:44.772962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:44.781799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:44.790180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:44.799987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 131/259] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:44 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:44.817704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:44.984840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:45.169369 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:45.189158 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9528-76ab-4f28-ad25-5a4ed80d6c49 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:45.215966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e533cc-0856-463e-a972-27bfeebec642 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:45.259980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:45.259980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:45.259980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:45.259980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/a6785b6be1b94832a816c21fc52a24fc/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:45.260646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, user_id=a6785b6be1b94832a816c21fc52a24fc, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:45.261883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:45.300940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 132/260] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:44 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/a6785b6be1b94832a816c21fc52a24fc/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:45.304841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:45.373830 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:45.375455 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:45.379533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:45.380664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:45.636615 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd9ed0-8e60-49e2-950f-e573833eefc0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:45.689840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:45.691899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:45.700768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:45.701479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:45.701804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:45.702082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:45.736994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:45.742493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:45.744331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:45.745231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 133/261] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:45.752888 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:45.776873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:45.860364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:45.954484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 129/262] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:45.961738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.098419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ed03-42a8-4abc-a9ff-7b34fea2268a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.172926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.173572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.173853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.174118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.174833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:46.175125 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.177259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.190892 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 134/263] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:46.209454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.244663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c956-9a47-44a2-befc-810e55043426 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.359790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:46.389418 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.390123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.390448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.390733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.396826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.398782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.402557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 130/264] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:45 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:46.421712 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.466673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8249-5972-441d-a9ad-cf7eb0495d0b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.522743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:46.574683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.575364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.575645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.575948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] PATH_INFO: `/v3/users/48beb5c5df594256b31016cca9c50031` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.578580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] RBAC: Authorizing `identity:get_user(user_id=48beb5c5df594256b31016cca9c50031)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.580468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.582504 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 135/265] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:46 2022] GET /identity/v3/users/48beb5c5df594256b31016cca9c50031 => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:46.593242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.743315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57193d3-4c38-4dd0-af62-2167b628124f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.870938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.872038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.872533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.872994 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.874484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=48beb5c5df594256b31016cca9c50031) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:46.875027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.878036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc3383-077c-4f75-b94b-52737542c82b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.904830 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 131/266] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:46 2022] GET /identity/v3/role_assignments?user.id=48beb5c5df594256b31016cca9c50031&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 608 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:46.962932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804025-593a-41e7-904f-4a16afd84f6b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.963364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804025-593a-41e7-904f-4a16afd84f6b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.963816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804025-593a-41e7-904f-4a16afd84f6b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.970306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47411f6-38af-4472-87a9-7e888be88810 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.970982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 132/267] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:46.986100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae785d4-94a5-4832-952a-5eed4a600cb9 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.986510 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae785d4-94a5-4832-952a-5eed4a600cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.986924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae785d4-94a5-4832-952a-5eed4a600cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.037680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-3ae785d4-94a5-4832-952a-5eed4a600cb9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:47.040100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-3ae785d4-94a5-4832-952a-5eed4a600cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:47.095306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:47.096375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.096838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.097337 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.109110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:47.255745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 133/268] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:47.366062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:47.368992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dffbd-a41d-4fe4-b707-747d7642d8c9 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:47.557529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035f70-fe38-40c2-bf93-dc9d206b82e1 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.558016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035f70-fe38-40c2-bf93-dc9d206b82e1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.558340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b035f70-fe38-40c2-bf93-dc9d206b82e1 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.562392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 134/269] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:47.571489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33eb26-f226-40ae-8c96-d884aacad7b9 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.572156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33eb26-f226-40ae-8c96-d884aacad7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.572573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33eb26-f226-40ae-8c96-d884aacad7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.606708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-7f33eb26-f226-40ae-8c96-d884aacad7b9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:47.608757 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-7f33eb26-f226-40ae-8c96-d884aacad7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:47.637659 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 136/270] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1047 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:18:47.639335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4b0a-17b9-4534-ac8a-f215956b5f26 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.639835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4b0a-17b9-4534-ac8a-f215956b5f26 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.640298 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4b0a-17b9-4534-ac8a-f215956b5f26 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.642308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 137/271] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:47.650602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4b0a-17b9-4534-ac8a-f215956b5f26 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:47.657561 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:47.735124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:47.740802 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 135/272] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:47.743213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.743690 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.744199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.798625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:47.800837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:47.892583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4b0a-17b9-4534-ac8a-f215956b5f26 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:47.904397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 136/273] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:47.905687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:47.958310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:47.959416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:47.960149 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:47.960443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:47.962722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:47.965603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:47.969226 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 138/274] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:47 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:47.978578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.016193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.036030 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfbb75-5348-422f-8f2a-7580ce6ec1d2 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.083268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.084366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.084866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.085332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.106546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:48.112317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:48.113348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:48.114274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:48.117000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 137/275] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:48.128982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.183062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f13d-4e8c-4987-bdf9-304047ca4dda None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.187740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.270359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.271220 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.271408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.271652 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.272519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] RBAC: Adding query filter params (role.id=0df241ea8604447fb366198675e1711a, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=48beb5c5df594256b31016cca9c50031) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:48.272772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:48.274409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:48.275458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625dde9-9f79-4c34-8df2-4853c8aea7d0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.292918 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 139/276] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:47 2022] GET /identity/v3/role_assignments?user.id=48beb5c5df594256b31016cca9c50031&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=0df241ea8604447fb366198675e1711a => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:48.294004 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.326184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.326825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.327106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.327381 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.328816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:48.329131 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:48.331040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:48.345400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 138/277] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:48.356999 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.379785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.479937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b539-600c-4c4a-8740-3dfeba8bf819 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.530616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.531533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.531988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.532397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.553335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:48.554313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276467be-5d8d-4a06-b4a9-582885275f3f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:48.562255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:48.563222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:48.564114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:48.566184 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 140/278] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:48.574168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.609616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.611249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.612174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.612901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] PATH_INFO: `/v3/users/eea181fe2c964448892d24c994643534` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.626961 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.640005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] RBAC: Authorizing `identity:get_user(user_id=eea181fe2c964448892d24c994643534)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:48.643420 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:48.647152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 139/279] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/users/eea181fe2c964448892d24c994643534 => generated 293 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:48.649152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.761908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693f77d-5a3e-4b9b-ba7b-03d3c6e9d93e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.789293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.818750 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.819370 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.819643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.819943 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.820707 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:48.821399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:48.822656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:48.837632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 141/280] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:48.837632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.845844 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9312-57d0-41f1-8f2a-f28e43fb20b6 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:48.899582 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:48.900251 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.900558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.900808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.902048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:48.903598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:48.905296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 140/281] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:48.906139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.975594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.992166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282355bf-5690-41ae-a43d-b4bf2be961b0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.042686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.043388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.043563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.043916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.044554 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, user.id=eea181fe2c964448892d24c994643534, scope.system=all) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:49.044856 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.046298 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.053541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 142/282] 10.222.0.75 () {56 vars in 1308 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/role_assignments?user.id=eea181fe2c964448892d24c994643534&scope.system=all&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:49.054407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:49.075841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096b289-6c7c-4141-8cd2-fbb99c1dbbd0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.143928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.143928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.143928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.143928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] PATH_INFO: `/v3/users/971049d98edb4ce680a40259c2052506` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.145505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] RBAC: Authorizing `identity:get_user(user_id=971049d98edb4ce680a40259c2052506)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.147225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.149533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 141/283] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/users/971049d98edb4ce680a40259c2052506 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:49.155788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:49.171837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:49.229866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af912b-29fc-400f-8349-2e5b9127859b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.326822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.329103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.330497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.331438 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.332475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.333846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c167-9f48-483a-8f65-5eb940568d36 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.334683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.366576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 143/284] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:18:49 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:49.391909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.393041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.393523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.394255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.396522 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.398315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2de13-3859-4fd6-8f4a-6b96b3191009 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.408085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 142/285] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:49 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:49.411901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:49.438271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:49.528265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd8a8-ba0d-49a8-ba2b-a99845a4e824 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.528720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd8a8-ba0d-49a8-ba2b-a99845a4e824 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.528930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd8a8-ba0d-49a8-ba2b-a99845a4e824 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.531083 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 143/286] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:49.541962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.542481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.543002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.570360 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:49.580017 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:49.616573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3dee-ddb2-45d7-8aeb-917855fc478b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.686576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.687791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.688326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.688807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/971049d98edb4ce680a40259c2052506/roles/28a42604da0d480ba626975b5697b7a2` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.693733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, user_id=971049d98edb4ce680a40259c2052506, role_id=28a42604da0d480ba626975b5697b7a2)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.695146 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.700596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:49.707581 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 144/287] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:49.727418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 144/288] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:18:49 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/users/971049d98edb4ce680a40259c2052506/roles/28a42604da0d480ba626975b5697b7a2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:18:50.128959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:50.320816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23fbfc-28e4-41b9-a8ab-de519dc5ed37 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:50.372545 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:50.373216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:50.373442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:50.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:50.386459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:50.391319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:50.392286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:50.393601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 145/289] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:50.401061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:50.548205 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:50.594536 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b927b95-1121-4c6c-99ee-71df966930cf None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:50.651022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:50.651567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:50.651845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:50.652136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:50.652813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:50.653111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:50.654497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:50.668839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 145/290] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:50.675483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:50.778604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:50.835865 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853876b7-2dba-400c-8a81-f8111316e43a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:50.888719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:50.889388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:50.889671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:50.889935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] PATH_INFO: `/v3/users/a6785b6be1b94832a816c21fc52a24fc` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:50.891865 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] RBAC: Authorizing `identity:get_user(user_id=a6785b6be1b94832a816c21fc52a24fc)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:50.893402 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:50.896174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 146/291] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:50 2022] GET /identity/v3/users/a6785b6be1b94832a816c21fc52a24fc => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:50.901768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:51.102766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce3f93-e6d9-4388-974a-07ad999cfebe None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:51.148139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:51.157495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:51.157495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.157495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.157495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.262388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:51.264329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:51.431231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 146/292] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:18:51.441111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:51.597246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cba7f-27f0-41f9-93d2-9438521c365d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:51.647490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:51.663001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:51.663645 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.663938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.664274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.666003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:51.667509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c2c94-ff51-4f66-9ca5-6d28ae4b94c9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:51.669596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 147/293] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:51 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:51.677745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:51.733415 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:51.840135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eafaa1-6648-4e2d-98c2-1f8b62306974 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:51.896670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:51.897701 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.898181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.898752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.899773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=a6785b6be1b94832a816c21fc52a24fc) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:51.900357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:51.902078 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40215b2a-fa89-4a3c-a022-928bd6cda116 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:51.914640 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 147/294] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:51 2022] GET /identity/v3/role_assignments?user.id=a6785b6be1b94832a816c21fc52a24fc&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:52.133169 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a697-489f-4fdd-8d87-9e848569921c None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.133631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a697-489f-4fdd-8d87-9e848569921c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.133784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a697-489f-4fdd-8d87-9e848569921c None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.135658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 148/295] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:52.141910 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5540-388e-47c1-87b2-57e7d215d966 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.142277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5540-388e-47c1-87b2-57e7d215d966 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.142599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5540-388e-47c1-87b2-57e7d215d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.174305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ab8f5540-388e-47c1-87b2-57e7d215d966 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:52.180166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ab8f5540-388e-47c1-87b2-57e7d215d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.260201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 148/296] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:52.634586 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a697-489f-4fdd-8d87-9e848569921c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:52.658585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1daa0-c8f7-4dde-9ea2-331e3aefd5ed None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.659178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1daa0-c8f7-4dde-9ea2-331e3aefd5ed None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.659402 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1daa0-c8f7-4dde-9ea2-331e3aefd5ed None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.660928 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 149/297] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:52.667079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300902e-eec4-4caf-bc4d-8296bebae56e None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.667361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300902e-eec4-4caf-bc4d-8296bebae56e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.667583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300902e-eec4-4caf-bc4d-8296bebae56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.690190 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-d300902e-eec4-4caf-bc4d-8296bebae56e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:52.691908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-d300902e-eec4-4caf-bc4d-8296bebae56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.721477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:52.764709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a697-489f-4fdd-8d87-9e848569921c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:52.788072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 150/298] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:52.797752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590b5f-cf92-4635-8fc7-8919a484e5fb None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.798061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590b5f-cf92-4635-8fc7-8919a484e5fb None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.798274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee590b5f-cf92-4635-8fc7-8919a484e5fb None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.799640 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 151/299] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:52.805437 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcd51e-19d9-44c1-8735-b9de8ec5fb7c None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.806117 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcd51e-19d9-44c1-8735-b9de8ec5fb7c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.806589 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcd51e-19d9-44c1-8735-b9de8ec5fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.815328 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:52.816002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.816282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.816550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.826856 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-c7fcd51e-19d9-44c1-8735-b9de8ec5fb7c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:52.828718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-c7fcd51e-19d9-44c1-8735-b9de8ec5fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.828826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:52.834733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:52.835633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:52.841908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 149/300] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:52.844206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:52.917169 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:52.923069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 152/301] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:52.923069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19b471-2977-4183-98d1-bd21eed9cf28 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.923069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19b471-2977-4183-98d1-bd21eed9cf28 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.923069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19b471-2977-4183-98d1-bd21eed9cf28 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.923069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 153/302] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:52.932842 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.933126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.933403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.955073 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:52.956330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.976393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34494-21af-4df8-a1f6-289b1b3289f3 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.023917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.024663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.025205 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.025482 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.026598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:53.027172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.029261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.036575 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 154/303] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:53.039853 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 150/304] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:53.045701 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.064894 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.141052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.159608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf007-7016-4979-a023-bbb2f8c91110 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.205416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.206222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.206680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.207237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] PATH_INFO: `/v3/users/eea181fe2c964448892d24c994643534` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.209193 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] RBAC: Authorizing `identity:get_user(user_id=eea181fe2c964448892d24c994643534)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.210969 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.213920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 155/305] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/users/eea181fe2c964448892d24c994643534 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:53.219137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.262145 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dbb6-4779-4eed-9493-d0544d50e5c5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.287163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.312146 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.312858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.313148 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.313396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.314492 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.316037 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.317676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 151/306] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:53.318499 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.346110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.367805 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e504-78fd-4b93-9d43-1db21ae74947 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.409333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.410077 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.410373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.410789 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] PATH_INFO: `/v3/system/users/eea181fe2c964448892d24c994643534/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.413023 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eea181fe2c964448892d24c994643534, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.415853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.427611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 156/307] 10.222.0.75 () {58 vars in 1334 bytes} [Tue Aug 23 23:18:53 2022] PUT /identity/v3/system/users/eea181fe2c964448892d24c994643534/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:18:53.433448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.448599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159b9e5-54cf-403f-b431-909a03faca73 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.491896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.492460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.492734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.493002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.505744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:53.514203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:53.515276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:53.516113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 152/308] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:53.522220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.587038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.588538 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9318-9662-4cef-a271-bb2b475b5e73 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.635521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.635752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.636024 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.636301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] PATH_INFO: `/v3/groups` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.637506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.638613 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.661777 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 157/309] 10.222.0.75 () {60 vars in 1134 bytes} [Tue Aug 23 23:18:53 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:53.662661 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.668746 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c197a-947a-46df-af42-d7a52b57ca81 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.675825 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.720988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.721843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.722229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.722676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.737879 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:53.744424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:53.745626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:53.747423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 153/310] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:18:53.752583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.847019 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3b5b-c05a-45fe-9543-13e2eb1be273 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.898121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.899100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.899395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.899779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.900533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:53.900840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.902451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.912735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 158/311] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:53.919281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.921780 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195630b5-3c7d-4515-8a2c-fb0dc4ca348f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.929899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.974217 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.975113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.975482 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.975951 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.976927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:53.977365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.979061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.993565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 154/312] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:53.999639 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:54.015939 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.058506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a3cc-f787-42c3-a25e-4e4eac5e04ed None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.113719 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.114641 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.115337 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.116069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] PATH_INFO: `/v3/users/f89f008d942649d4b4b6bab1521aae90` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.138894 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] RBAC: Authorizing `identity:get_user(user_id=f89f008d942649d4b4b6bab1521aae90)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.140764 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.148009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 159/313] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/users/f89f008d942649d4b4b6bab1521aae90 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:54.149406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:54.166508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233141a-8118-4fc3-a73f-470c5a5a7589 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.225431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3185-20db-48e7-9216-785320718c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.226196 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3185-20db-48e7-9216-785320718c72 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.226600 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3185-20db-48e7-9216-785320718c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.226902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db3185-20db-48e7-9216-785320718c72 None admin] PATH_INFO: `/v3/users/971049d98edb4ce680a40259c2052506` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.229471 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db3185-20db-48e7-9216-785320718c72 None admin] RBAC: Authorizing `identity:get_user(user_id=971049d98edb4ce680a40259c2052506)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.232224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db3185-20db-48e7-9216-785320718c72 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.235010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 155/314] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/users/971049d98edb4ce680a40259c2052506 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:54.242260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3185-20db-48e7-9216-785320718c72 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:54.313897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.332103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d82c2-4c07-4b92-9602-0db6c5256b8f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.372894 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.383921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.384523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.384922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.385244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.386034 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, user.id=f89f008d942649d4b4b6bab1521aae90, scope.system=all) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:54.386338 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.388197 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.401105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 160/315] 10.222.0.75 () {56 vars in 1308 bytes} [Tue Aug 23 23:18:54 2022] GET /identity/v3/role_assignments?user.id=f89f008d942649d4b4b6bab1521aae90&scope.system=all&role.id=28a42604da0d480ba626975b5697b7a2 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:54.401486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db3185-20db-48e7-9216-785320718c72 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.443206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.444259 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.444747 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.445313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.560997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.563705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.617165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.703132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 156/316] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:18:54.711907 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:54.870230 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfaf1d-1fa1-4d69-a899-d55ed6c16e4a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.918971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.919969 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.920472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.920937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.922346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.924111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d909-431d-428d-8946-5a52d0ea28ce None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.926339 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 161/317] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:18:54 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:54.932877 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:55.110626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bb8c-74e2-42d1-a2cd-66a0c0a8b800 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:55.156951 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:55.157538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.157813 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.158076 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:55.158874 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d, user.id=971049d98edb4ce680a40259c2052506) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:55.159182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:55.160750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97e900-924f-4020-86a2-7da9623e87f3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:55.168796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 157/318] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:18:54 2022] GET /identity/v3/role_assignments?user.id=971049d98edb4ce680a40259c2052506&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=28a42604da0d480ba626975b5697b7a2 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:55.169388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:55.987433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d6391-a1ec-4f37-b20c-f7af29a2120b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.988218 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d6391-a1ec-4f37-b20c-f7af29a2120b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.988381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d6391-a1ec-4f37-b20c-f7af29a2120b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:55.990275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 162/319] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:55.995927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.996598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.996598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.018317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:56.019555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:56.093842 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 158/320] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:18:56.418251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef19a-1163-4e0f-a930-eed9b79a88be None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.418627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef19a-1163-4e0f-a930-eed9b79a88be None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.419118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef19a-1163-4e0f-a930-eed9b79a88be None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.420058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:56.420968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 163/321] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:56.426925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.427209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.427484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.452738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:56.454535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:56.523399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:56.556026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 164/322] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:56.556300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc04cd-57f5-425d-9a2c-e5bb38f5634e None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:56.586883 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:56.594969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:56.595611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.595918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.596184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.609175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:56.614191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:56.615081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:18:56.620473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 159/323] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:56.621999 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:56.743587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11ca82-d1ba-4079-9ee6-b13ffa28bb9d None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:56.782003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:56.782632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.782899 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.783158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.783831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:56.784170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:56.785585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915733-7a09-4499-8dd7-47fd1407beae None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:56.794603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 165/324] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:56.800269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:56.844430 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10bc7-8b8b-4987-94ae-5aa4331701e7 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.844726 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10bc7-8b8b-4987-94ae-5aa4331701e7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.844901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10bc7-8b8b-4987-94ae-5aa4331701e7 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.846768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 166/325] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:18:56.852019 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.852397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.852679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.873934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:56.875467 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:56.922238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6255-43a0-4bf6-b38a-e923d0c69bb1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:56.929157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:56.954633 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 167/326] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:18:56.966574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:56.967261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.967540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.967812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] PATH_INFO: `/v3/users/eea181fe2c964448892d24c994643534` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.968984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] RBAC: Authorizing `identity:get_user(user_id=eea181fe2c964448892d24c994643534)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:56.970460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:56.972253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 160/327] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:56 2022] GET /identity/v3/users/eea181fe2c964448892d24c994643534 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:56.978691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.095682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdbb6e-dc83-420b-ac14-3256e9458819 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.134643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.135350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.135629 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.135930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.136699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] RBAC: Adding query filter params (role.id=2cb849773c2647be9ff33d4efbb48203, user.id=eea181fe2c964448892d24c994643534, scope.system=all) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:57.136999 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.138530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.154060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 168/328] 10.222.0.75 () {56 vars in 1308 bytes} [Tue Aug 23 23:18:56 2022] GET /identity/v3/role_assignments?user.id=eea181fe2c964448892d24c994643534&scope.system=all&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:57.171973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.264745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:57.285390 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.325551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d94cbb-c0be-4a6e-97fe-677de5720076 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.340982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:57.367339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.368012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.368296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.368555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.369735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.371472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.373204 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 161/329] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:57.378987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.417908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997217-153b-4207-b465-6e0009e7d5f1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.455094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.455774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.456080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.456358 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.467554 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:18:57.472852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:18:57.473774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:18:57.476012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 169/330] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:18:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:18:57.480693 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.495504 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bcec1-b73a-40c7-9340-89c2b57e8166 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.522888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:57.533007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.533625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.533898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.534163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] PATH_INFO: `/v3/groups` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.534785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.536288 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.553984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 162/331] 10.222.0.75 () {60 vars in 1134 bytes} [Tue Aug 23 23:18:57 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:18:57.596181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:57.600322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b697-56a8-4120-a9bb-ade01d13d4cd None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.639222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.639751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.640056 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.640324 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.641027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:18:57.641320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.642735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.654967 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 170/332] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:18:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:18:57.661452 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.783711 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7183d0-888b-4196-86a3-e1de196053f8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.823990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.824654 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.824931 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.825202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] PATH_INFO: `/v3/users/f89f008d942649d4b4b6bab1521aae90` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.826370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] RBAC: Authorizing `identity:get_user(user_id=f89f008d942649d4b4b6bab1521aae90)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.831468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6589b-b5a3-46fb-9eef-ea92cfa7ffef None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.831468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 163/333] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:18:57 2022] GET /identity/v3/users/f89f008d942649d4b4b6bab1521aae90 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:57.836913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.956471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2773c-400e-48ae-b1f3-4bd691bfdcc7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.993470 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.994139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.994409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.994682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] PATH_INFO: `/v3/system/users/f89f008d942649d4b4b6bab1521aae90/roles/28a42604da0d480ba626975b5697b7a2` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.996265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f89f008d942649d4b4b6bab1521aae90, role_id=28a42604da0d480ba626975b5697b7a2)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.997755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2afa2-3de8-4a14-af7e-bad58de6af97 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:58.007262 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 171/334] 10.222.0.75 () {58 vars in 1334 bytes} [Tue Aug 23 23:18:57 2022] PUT /identity/v3/system/users/f89f008d942649d4b4b6bab1521aae90/roles/28a42604da0d480ba626975b5697b7a2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:01.125454 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70dd78-aa68-4b81-ad56-3f31e665caa2 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.126320 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70dd78-aa68-4b81-ad56-3f31e665caa2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.126767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70dd78-aa68-4b81-ad56-3f31e665caa2 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.128620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 164/335] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:01.136837 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd53a25-e1a0-4de2-a4e7-e11afb97379b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.137686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd53a25-e1a0-4de2-a4e7-e11afb97379b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.138102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd53a25-e1a0-4de2-a4e7-e11afb97379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.161425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ebd53a25-e1a0-4de2-a4e7-e11afb97379b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:01.163051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ebd53a25-e1a0-4de2-a4e7-e11afb97379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:01.192902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:01.266495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 172/336] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:01.371762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e4a1-1096-44e0-b8b4-b562ba96feee None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.372562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e4a1-1096-44e0-b8b4-b562ba96feee None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.373182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e4a1-1096-44e0-b8b4-b562ba96feee None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.376090 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 165/337] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:01.382746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.383662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.384407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.421739 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:01.424088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:01.516367 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a29938-7d55-439e-ba25-a96e06c61e7a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.516991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a29938-7d55-439e-ba25-a96e06c61e7a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.517480 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a29938-7d55-439e-ba25-a96e06c61e7a None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.519065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 166/338] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:01.531901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde95a-4f8c-4ad8-96cf-2ef3538123b5 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.531901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde95a-4f8c-4ad8-96cf-2ef3538123b5 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.531901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde95a-4f8c-4ad8-96cf-2ef3538123b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.535861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 173/339] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:01.555717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-86fde95a-4f8c-4ad8-96cf-2ef3538123b5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:01.556967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-86fde95a-4f8c-4ad8-96cf-2ef3538123b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:01.621824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:01.654893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 167/340] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:01.896876 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:01.899345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5504d8-26e4-4139-aac0-44956215f3ed None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.899658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5504d8-26e4-4139-aac0-44956215f3ed None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.899977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5504d8-26e4-4139-aac0-44956215f3ed None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.901676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 168/341] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:01.908225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea60b-22f9-42d5-bc96-58b49e14016b None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:01.908731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea60b-22f9-42d5-bc96-58b49e14016b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:01.909202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea60b-22f9-42d5-bc96-58b49e14016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:01.944960 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-29aea60b-22f9-42d5-bc96-58b49e14016b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:01.946419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-29aea60b-22f9-42d5-bc96-58b49e14016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:02.015178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:02.034320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a8b71-a3a0-475a-8da4-b6410b842fe8 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.092270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 169/342] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:02.094193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1787-bf75-4708-9045-7c8102d75a96 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.094792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1787-bf75-4708-9045-7c8102d75a96 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.095381 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed1787-bf75-4708-9045-7c8102d75a96 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.097068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 170/343] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:02.103651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.104362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.104809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.121052 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.122042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.122524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.123014 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.135576 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:02.136834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:02.153185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:02.161658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:02.162600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:02.163455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:02.170501 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 174/344] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:02.171769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.249392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 171/345] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:02.250619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.310740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62fea2-43d6-4687-a556-173f3035398a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.319289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:02.354656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.355667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.356202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.356691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.370499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:02.377158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:02.378085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:02.378968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:02.381491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 175/346] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:02.382716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.390670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bdaf6-62fd-4f40-9c78-a719633374a6 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.393186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:02.433466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.434341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.434754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.435250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.436103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:02.436587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:02.438283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:02.449412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 172/347] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:02.450843 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.539521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7d8a-178a-4aca-a42e-f26765ab9702 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.589102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b596-c7fb-4656-b7eb-f7fc46e34295 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.605841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.606134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.606466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.606768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.620500 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:02.626728 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:02.636559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:02.641059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 176/348] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:02.643938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.665163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.666756 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.667462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.670153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.671813 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:02.672906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:02.676033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:02.688514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 173/349] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:02.690056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.734139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:02.777614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1110d7-cdab-49ab-952f-6a0cafa0b41d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.829852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.830502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.830835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.831109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.847768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b19b-1b39-41fd-bd26-17b70253731c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:02.891053 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:02.892136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:02.892709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:02.893175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:02.894153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:02.894650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:02.896279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:02.908556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 174/350] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:02.910310 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:02.920596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:02.926515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:02.970680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.025803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.081263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35ebb3-450e-42e6-9a1f-8f20c6878678 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:03.111168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 177/351] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:03.111168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.138454 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:03.140458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.140458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.140458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.261702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:03.263191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:03.291995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0adf73-1f2d-449c-b406-786d3a57a2d1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:03.309469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.344448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:03.345095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.345370 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.345642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.359259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:03.364444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:03.365357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:03.366137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 178/352] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:03.366903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.406031 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 175/353] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:03.406255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.407019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.551950 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4d01e-b262-4388-bab3-f2d637b5388b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:03.584035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf5367-2016-4719-97cf-9176ea8e7f15 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:03.620591 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:03.621980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.622684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.623165 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.626404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.635945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:03.636621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.636896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.637153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.650708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:03.655573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:03.656591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:03.657399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 176/354] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:03.658101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.721825 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:03.723346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:03.765496 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:03.788682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ebc1-aa9e-4c37-baf3-8fb8c487532e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:03.843953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:03.845222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.845504 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.845769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.849962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:03.851839 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff7237-2d99-4ee3-9534-a761a2d72703 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:03.855973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 177/355] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:03.857305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51238b-0f45-492c-b704-877c5f4a54a0 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:03.857598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51238b-0f45-492c-b704-877c5f4a54a0 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:03.857914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51238b-0f45-492c-b704-877c5f4a54a0 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:03.859236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 178/356] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:03.859977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51238b-0f45-492c-b704-877c5f4a54a0 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.888692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 179/357] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:03.889483 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:03.953779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.015704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51238b-0f45-492c-b704-877c5f4a54a0 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.033527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630da4-fcf4-4e80-a5f3-3f1104d6db64 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.068810 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.071365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.071998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.072274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.072543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.073222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:04.073520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.074960 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.083117 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.084305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.084461 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.084752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.086268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.087344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 179/358] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.087801 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.088326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.089654 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 180/359] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:03 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.090395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.249198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b2c6-2f8f-4633-9acd-8a9f537034ca None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.252014 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edadae-6924-4e32-80b0-9adcdfe83d05 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.285674 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.310669 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.311665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.312136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.312416 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.313068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:04.313224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.313911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.314040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.314200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.314507 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.314801 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815844-30e5-4abe-ac53-cd5fdcab8a07 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.325098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.326219 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 180/360] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.326797 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.327785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.328100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.328370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.329171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 181/361] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.333800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.352132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:04.353626 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:04.425952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.453385 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 181/362] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:04.455199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.486785 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6312-0229-447f-a3a3-0fbd821ff659 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.539653 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.540154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.540359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.540637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.549594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.551283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.558420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 182/363] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.558420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.624916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211251-b44a-4d7a-9293-1ec3b9bcc62a None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.653029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.685294 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.686119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.686413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.687231 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.688493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.690484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.699369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 182/364] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.699369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.731479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4fa8a-07ea-4b07-9e6a-c0e7c2fd19a0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.771408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.783035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.783708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.784122 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.784575 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] PATH_INFO: `/v3/users/f89f008d942649d4b4b6bab1521aae90` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.785898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] RBAC: Authorizing `identity:get_user(user_id=f89f008d942649d4b4b6bab1521aae90)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.787460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.792005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 183/365] 10.222.0.75 () {56 vars in 1177 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/users/f89f008d942649d4b4b6bab1521aae90 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.792005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.859856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40a713-b711-4784-b4d1-3a15be447659 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.906036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.906719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.907007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.907279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.924422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f870b28-3fb5-437d-a54b-ef72226a9851 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:04.961594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:04.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:04.962481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:04.962743 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:04.963472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=0df241ea8604447fb366198675e1711a, scope.project.id=7876a52b82454de19a81f60278c91be6) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:04.963774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.965266 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:04.966669 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:04.972400 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 184/366] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=0df241ea8604447fb366198675e1711a => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:04.973256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:04.993443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:04.994990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:05.059700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.114773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c10c5-c428-4bcd-89e0-ce897e5cf0fb None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:05.136650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 183/367] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:05.136650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.170944 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:05.171889 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:05.172302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:05.172689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:05.174243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:05.176444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:05.178426 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 185/368] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:04 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:05.179534 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.266957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.297988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba910f0e-9a9d-4ecc-a757-a9f7c8ce1cd2 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:05.342519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfc20-1ac1-4758-b881-1130ef57e65f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:05.345556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:05.346464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:05.346966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:05.347270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:05.348114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:05.348558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:05.350402 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:05.367924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 184/369] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:05.367924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.390887 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.411329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:05.414022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:05.415460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:05.416215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:05.419158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] RBAC: Adding query filter params (role.id=28a42604da0d480ba626975b5697b7a2, user.id=f89f008d942649d4b4b6bab1521aae90, scope.system=all) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:05.420456 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:05.424010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:05.455913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 186/370] 10.222.0.75 () {56 vars in 1308 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/role_assignments?user.id=f89f008d942649d4b4b6bab1521aae90&scope.system=all&role.id=28a42604da0d480ba626975b5697b7a2 => generated 510 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:05.457180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.650198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0fd8f-eb27-4178-aa63-a3a4af9be0f5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:05.713702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1b4bc-c9a3-4d70-97d2-e57ef0e3bc80 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:05.730668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:05.731657 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:05.732236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:05.732686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:05.763229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:05.768936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:05.770566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:05.772062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:05.775563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 185/371] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:05.776502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.780890 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.805333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:05.806715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:05.807249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:05.808778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:05.810133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:05.815315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:05.817680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 187/372] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:05.819223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:05.931104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.969066 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fb825-2a17-4284-afb2-b952d0266446 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:06.033504 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86429f-4772-4e2a-b452-8ff385c1105d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:06.040559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:06.041591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:06.042010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:06.042433 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:06.043654 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=7876a52b82454de19a81f60278c91be6) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:06.044174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:06.046717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:06.058860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 186/373] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:06.068589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:06.106741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:06.107646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:06.108107 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:06.108528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:06.109817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:06.110301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:06.113021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:06.131664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 188/374] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:06.140049 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:06.297404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:06.419265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd4bf-54ed-4c5e-b594-77e735e2c099 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:06.499306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:06.500327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:06.500762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:06.501185 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:06.502943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:06.505305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:06.508663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 187/375] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:06 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:06.509207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4bab7-0f5f-4520-b19e-5b22ac6d5020 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:06.521484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:06.543644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:06.621770 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:06.622750 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:06.623221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:06.623689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:06.782583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:06.784831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:06.847284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420682-ac0f-4717-b57d-c25de2c2a062 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:06.944744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:06.944744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:06.944744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:06.945212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:06.945602 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=0df241ea8604447fb366198675e1711a, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:06.945900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:06.947397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:06.951052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:06.960325 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 188/376] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:06 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=0df241ea8604447fb366198675e1711a => generated 260 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:07.002775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 189/377] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:07.013045 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:07.310136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c69c4-69a8-476d-9d29-cbd7daad0532 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:07.372246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:07.372892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:07.373168 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:07.373438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] PATH_INFO: `/v3/projects/44a6d06c119f40359a0b6c352385f165` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:07.374688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] RBAC: Authorizing `identity:get_project(project_id=44a6d06c119f40359a0b6c352385f165)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:07.376293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:07.382954 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 189/378] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:07 2022] GET /identity/v3/projects/44a6d06c119f40359a0b6c352385f165 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:07.384938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:07.421200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:07.583482 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8e932-e7f9-4968-84e9-48e373fec31c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:07.634905 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:07.636582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:07.637377 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:07.638147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] PATH_INFO: `/v3/groups/1ec086848b234ae3b282fe8905552b6d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:07.652280 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] RBAC: Authorizing `identity:get_group(group_id=1ec086848b234ae3b282fe8905552b6d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:07.655368 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8b0a-6ce0-4e62-9d6a-4518b7bfaf55 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:07.662720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 190/379] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:07 2022] GET /identity/v3/groups/1ec086848b234ae3b282fe8905552b6d => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:07.669449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:07.806550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:07.861321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad879a78-5de4-4359-9e7d-bb4c1a5b28d2 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:07.937008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:07.938503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:07.939200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:07.939936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:07.941445 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] RBAC: Adding query filter params (group.id=1ec086848b234ae3b282fe8905552b6d, role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=44a6d06c119f40359a0b6c352385f165) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:07.942191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:07.944939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3cc7-b8a1-4e66-a836-a426701f18c6 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:07.957408 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 190/380] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:07 2022] GET /identity/v3/role_assignments?group.id=1ec086848b234ae3b282fe8905552b6d&scope.project.id=44a6d06c119f40359a0b6c352385f165&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:08.530689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47fec8-cf11-4776-a46e-950d9d426b71 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:08.530967 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47fec8-cf11-4776-a46e-950d9d426b71 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:08.531331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47fec8-cf11-4776-a46e-950d9d426b71 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:08.533034 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 191/381] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:08.539746 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e73a-f318-41e5-922e-037bbb244ec7 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:08.540590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e73a-f318-41e5-922e-037bbb244ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:08.540590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e73a-f318-41e5-922e-037bbb244ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:08.571325 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-2439e73a-f318-41e5-922e-037bbb244ec7 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:08.572833 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-2439e73a-f318-41e5-922e-037bbb244ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:08.713829 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 191/382] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:09.052881 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00fdb-f223-4687-bff8-cec7223ca7ef None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:09.053599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00fdb-f223-4687-bff8-cec7223ca7ef None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:09.053812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00fdb-f223-4687-bff8-cec7223ca7ef None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:09.055866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 192/383] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:09.063338 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:09.063690 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:09.064108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:09.095786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:09.097449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:09.205798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:09.227173 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 192/384] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:09.294353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00fdb-f223-4687-bff8-cec7223ca7ef None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:09.447690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:09.512584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00fdb-f223-4687-bff8-cec7223ca7ef None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:09.601296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:09.602154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:09.602435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:09.602703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:09.624321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:09.629617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:09.631131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:09.632708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 193/385] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:09.644124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:09.892669 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3336e-4aab-4912-a419-1b4684ae49b6 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:09.916993 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:09.957200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:09.957844 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:09.958123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:09.958457 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:09.959213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:09.959555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:09.961628 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd4dc-8137-41fb-91da-1a950d6a6189 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:09.978649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 193/386] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:09.984550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b58b3-c85a-40ab-b0e7-aa14d3799680 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:09.985181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b58b3-c85a-40ab-b0e7-aa14d3799680 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:09.985614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b58b3-c85a-40ab-b0e7-aa14d3799680 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:09.988011 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 194/387] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:09.989366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b58b3-c85a-40ab-b0e7-aa14d3799680 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.061890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41801-48de-43e1-8ecf-7e96e07a62a5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.069835 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.113578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.114641 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.115113 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.115533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.125708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.131702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-73e55038-4f73-4911-a071-3f45f992c084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:10.137980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:10.139096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:10.140098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:10.140704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b58b3-c85a-40ab-b0e7-aa14d3799680 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.142563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 194/388] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:10.144424 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.144977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.145463 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.167361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:10.169235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:10.192256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.192939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.193531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.194073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.196092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:10.197949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:10.199927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 195/389] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:09 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:10.201099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.256118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 195/390] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:10.256118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.365567 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3a905-ac06-4b8b-b5eb-92a0e2a17651 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.387185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304a7d8-7d4f-47f1-9f3a-e281dc7e47c5 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.401289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.423226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.424625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.425262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.425919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.427305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:10.428059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:10.431377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f14899-bafd-4931-9c32-f3b925c2352d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:10.440782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.455679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.456030 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 196/391] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:10.459425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.459425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.459425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.461199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd716-eee0-4f1d-8272-237b05ce56f1 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.461622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd716-eee0-4f1d-8272-237b05ce56f1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.462102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd716-eee0-4f1d-8272-237b05ce56f1 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.465064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:10.466573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:10.468559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 196/392] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:10 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:10.470120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.470262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 197/393] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:10.476808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dd716-eee0-4f1d-8272-237b05ce56f1 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.593188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0f74-ace7-41e7-ac6e-8be7aad1d178 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.622671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dd716-eee0-4f1d-8272-237b05ce56f1 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:10.652628 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.653346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.653728 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.654087 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.655515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:10.657804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13462ab-811b-4b16-8308-1527d79607bf None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:10.660186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 197/394] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:10 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:10.661503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.661803 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.662079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.686068 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:10.686498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:10.687224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:10.687359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:10.687491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:10.687956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/0df241ea8604447fb366198675e1711a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:10.691331 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, group_id=cf6cfba062d34e5d848e1ff300fbec2a, role_id=0df241ea8604447fb366198675e1711a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:10.693484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:10.720119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 198/395] 10.222.0.75 () {58 vars in 1442 bytes} [Tue Aug 23 23:19:10 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/0df241ea8604447fb366198675e1711a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:19:10.720909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.810365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.813375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.829941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 198/396] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:10.831372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:10.930839 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095d2f2-776a-4dea-bc2c-972e4cb3d88b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.018312 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.019427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.019854 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.020375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.049562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:11.056718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:11.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:11.060292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 199/397] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:11.065348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:11.109551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32111-b69d-43a6-9723-6330aaf721bf None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.174194 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.174934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.175344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.179675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.181142 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:11.182569 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:11.191396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 199/398] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:10 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:11.218515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:11.249212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3505c2-84d0-4ba8-8922-8ade3af1431d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.255976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:11.333029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.333989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.334290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.334571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.335307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] RBAC: Adding query filter params (name=member) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:11.335619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:11.337364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:11.346787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:11.352020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 200/399] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:11.353246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:11.405518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da039e-5133-418f-90fb-38d566220c8b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.469086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.469996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.470416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.470839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.474717 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, group_id=cf6cfba062d34e5d848e1ff300fbec2a, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:11.477674 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:11.508223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 200/400] 10.222.0.75 () {58 vars in 1442 bytes} [Tue Aug 23 23:19:11 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:11.508223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:11.540773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9ab57-88ce-4b21-945f-f0a9cf9529ae None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.656389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.657516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.658039 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.658519 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.680946 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-2df7da71-5268-4d96-907d-ecff7a141f61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:11.693549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:11.695059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:11.695889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:11.704137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 201/401] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:11.707292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f862-c102-4040-ae13-2986d9757598 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.707786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f862-c102-4040-ae13-2986d9757598 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.708304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93f862-c102-4040-ae13-2986d9757598 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.710785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 202/402] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:11.711409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93f862-c102-4040-ae13-2986d9757598 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:11.772267 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93019f-79f5-48b3-868c-1c511a6321b7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.775609 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:11.823476 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:11.845295 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.846574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.847189 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.847794 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.850177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:11.853617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed937961-f08f-45c8-864e-9d552fff7bf5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:11.864046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 201/403] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:11 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:11.867424 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.868097 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.868782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.887240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93f862-c102-4040-ae13-2986d9757598 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:11.902514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:11.905094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:11.945934 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:11.946566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:11.946841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:11.947118 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:11.947798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:11.948172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:11.949767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:11.961965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 203/404] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:11.962898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.038825 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 202/405] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:12.040510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.192466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:12.222064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f0c2-cb1d-41e1-b3d4-63c158afaac5 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:12.231250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58894b5-4f68-4bc9-9899-1b5e48067823 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:12.272351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:12.315130 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:12.316318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:12.318175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:12.318745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:12.322081 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:12.324822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:12.328239 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 203/406] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:12 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:12.335557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.347405 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:12.348464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:12.348914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:12.349380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:12.360346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:12.363095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:12.366694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 204/407] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:11 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:12.375441 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.484192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6da20-9cf1-4cc6-af57-04488e72fa61 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:12.528701 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:12.529746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:12.530229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:12.530738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:12.532296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:12.534047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:12.536382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 204/408] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:12 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:12.543641 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.618127 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7334-c23f-4fce-983c-e81df5f587cd None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:12.644414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:12.660677 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:12.661653 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:12.662107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:12.662541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:12.664774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=7876a52b82454de19a81f60278c91be6, group_id=cf6cfba062d34e5d848e1ff300fbec2a, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:12.666458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:12.691723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 205/409] 10.222.0.75 () {58 vars in 1442 bytes} [Tue Aug 23 23:19:12 2022] PUT /identity/v3/projects/7876a52b82454de19a81f60278c91be6/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:12.693318 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:12.742474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:12.757964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d45f-6d8f-4eb9-8af2-b730c6b2b12f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:12.828947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:12.830059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:12.831760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:12.832357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/0df241ea8604447fb366198675e1711a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:12.839673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] RBAC: Authorizing `identity:create_grant(project_id=48610a2636e84d8bb583e7f9fa3a615d, group_id=cf6cfba062d34e5d848e1ff300fbec2a, role_id=0df241ea8604447fb366198675e1711a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:12.845616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:12.866172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 205/410] 10.222.0.75 () {58 vars in 1442 bytes} [Tue Aug 23 23:19:12 2022] PUT /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d/groups/cf6cfba062d34e5d848e1ff300fbec2a/roles/0df241ea8604447fb366198675e1711a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:19:12.998894 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e428f8-1301-4cd8-9d86-0545dadf7d0c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:13.050351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:13.051427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:13.051867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:13.052315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:13.075253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:13.081702 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:13.083526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:13.085183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 206/411] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:13.094234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:13.287593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45e414-135a-4cfe-8fbd-a7ae24ceb625 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:13.314862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:13.343014 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:13.344069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:13.344563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:13.344931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:13.346045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:13.346518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:13.349222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:13.365039 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 206/412] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:13.375042 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:13.476101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:13.522353 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33563-3a04-4704-906b-479fedbdb38d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:13.578424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:13.578984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:13.579256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:13.579517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] PATH_INFO: `/v3/groups/1ec086848b234ae3b282fe8905552b6d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:13.580687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] RBAC: Authorizing `identity:get_group(group_id=1ec086848b234ae3b282fe8905552b6d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:13.582336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:13.583930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 207/413] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:13 2022] GET /identity/v3/groups/1ec086848b234ae3b282fe8905552b6d => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:13.590083 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:13.747594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af82ee-3513-4a66-8094-54ad53cd76cd None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:13.799707 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:13.800467 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:13.800753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:13.801030 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] PATH_INFO: `/v3/projects/44a6d06c119f40359a0b6c352385f165` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:13.802234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=44a6d06c119f40359a0b6c352385f165)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:13.803972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5ba3-7fd6-4479-9171-fa25e1768ae4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:13.805728 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 207/414] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:13 2022] GET /identity/v3/projects/44a6d06c119f40359a0b6c352385f165 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:13.812657 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:14.071129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85e33-46fc-43dd-828f-baddd0a59ed0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:14.145190 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:14.146327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:14.146910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:14.147526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] PATH_INFO: `/v3/projects/44a6d06c119f40359a0b6c352385f165/groups/1ec086848b234ae3b282fe8905552b6d/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:14.151328 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] RBAC: Authorizing `identity:create_grant(project_id=44a6d06c119f40359a0b6c352385f165, group_id=1ec086848b234ae3b282fe8905552b6d, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:14.154204 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970faf5-81f1-4474-91c7-a14f1afcaf94 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:14.181726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 208/415] 10.222.0.75 () {58 vars in 1442 bytes} [Tue Aug 23 23:19:13 2022] PUT /identity/v3/projects/44a6d06c119f40359a0b6c352385f165/groups/1ec086848b234ae3b282fe8905552b6d/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:14.417910 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d751-8099-4455-8710-5157cd7624da None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:14.418879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d751-8099-4455-8710-5157cd7624da None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:14.418879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d751-8099-4455-8710-5157cd7624da None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:14.420172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 208/416] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:14.434964 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c60-f474-47f0-b2e0-5ee2f2891863 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:14.435412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c60-f474-47f0-b2e0-5ee2f2891863 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:14.435857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310c60-f474-47f0-b2e0-5ee2f2891863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:14.452258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:14.475390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ac310c60-f474-47f0-b2e0-5ee2f2891863 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:14.478082 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ac310c60-f474-47f0-b2e0-5ee2f2891863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:14.605906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 209/417] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:15.006435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d751-8099-4455-8710-5157cd7624da None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:15.072906 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:15.097776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b9c3-cff4-4353-baa5-4a00be6438ba None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:15.098341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b9c3-cff4-4353-baa5-4a00be6438ba None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:15.098453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b9c3-cff4-4353-baa5-4a00be6438ba None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:15.101962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 210/418] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:15.108928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:15.109574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:15.110119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:15.143855 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:15.145560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:15.154414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d751-8099-4455-8710-5157cd7624da None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:15.210778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:15.211431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:15.211706 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:15.212012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:15.234893 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:15.245498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:15.246436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:15.247222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:15.256362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 209/419] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:19:15.263008 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:15.271034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 211/420] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:15.427490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc87c-a3c7-4896-b751-62b81d05a72c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:15.442561 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:15.487428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:15.488392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:15.488809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:15.489221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:15.490029 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:15.490491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:15.492246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:15.503921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 210/421] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:15.510375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:15.596644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:15.638669 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d25b-2cbc-43a2-81ea-aced4cced64d None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:15.676634 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:15.677331 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:15.677611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:15.677952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:15.771149 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:15.773004 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:15.843730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:15.886526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 212/422] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:15.893164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:15.993613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:16.051072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573105-b8da-47f8-b82e-8be2e3541915 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.098052 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.099891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.102595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.103050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.105340 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:16.107840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:16.112416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 211/423] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:15 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:16.124206 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:16.172955 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:16.196507 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae41f9-88f6-40b1-a2f6-d27396db5e71 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.243718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.244925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.245513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.246179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.254399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb90d9-6371-4b4d-bfc1-04e6ebf90777 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.266870 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5de13bf4-c444-4e38-b7d9-454ae0f3e09e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:16.274803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:16.275856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:16.276878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:16.279771 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 213/424] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:16.281753 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dc0e-2cea-4b4a-8679-787bd6778024 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.282436 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dc0e-2cea-4b4a-8679-787bd6778024 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.282987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dc0e-2cea-4b4a-8679-787bd6778024 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.285157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 214/425] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:16.294264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.294759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.295230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.304564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.305534 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.305996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.306438 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.308436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:16.311532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:16.319274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 212/426] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:16 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:16.319274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:16.325840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:16.328196 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:16.365370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:16.427224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 215/427] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:16.429200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:16.473936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984ec35-5357-47f9-91b8-3ad2e17816fe None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.478289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:16.536261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.537547 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.538318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.538968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.540000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:16.540513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:16.542105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea1a7-633b-4c6b-95dc-30547aa0159d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:16.558104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 213/428] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:16.560827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682fd7-9a0b-4148-963c-57024c7ebd77 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.561572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682fd7-9a0b-4148-963c-57024c7ebd77 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.562069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682fd7-9a0b-4148-963c-57024c7ebd77 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.566063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 214/429] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:16.568188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682fd7-9a0b-4148-963c-57024c7ebd77 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:16.639311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54a8a-99a1-4d5c-895c-cfe64561d0fe None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.697815 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.698909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.699394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.699897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.701147 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=0df241ea8604447fb366198675e1711a, scope.project.id=7876a52b82454de19a81f60278c91be6) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:16.702436 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:16.705031 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9de2-ffa6-4174-9c6f-406a0f8f6821 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:16.716118 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 216/430] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:16 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=0df241ea8604447fb366198675e1711a => generated 611 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:16.718730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.719428 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.720058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.741382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682fd7-9a0b-4148-963c-57024c7ebd77 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:16.747412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:16.750033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:16.777374 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:16.811663 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:16.812382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:16.812741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:16.813031 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:16.872634 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 217/431] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:16.873055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:16.945081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.003570 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:17.005606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:17.098267 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed866991-6477-4670-b4dc-83dac4b0372c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.177239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.178074 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.179476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.180061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.201875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 215/432] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:17.204430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:17.215421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:17.217230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:19:17.218837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:17.220336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.220430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 218/433] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:19:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:17.233227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.268409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:17.356525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:17.423062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02886c5a-e5c0-405c-86e8-d529ac3c7e11 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.429460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df0d08-7446-4a6e-af06-94799f0e5a4c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.476794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.478612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.479056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.479527 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.480808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:17.481324 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:17.483379 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.484105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:17.484471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.484869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.485153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.486779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:17.489130 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:17.496582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 216/434] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:17.496582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.509736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 219/435] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:17.511221 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.620155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:17.651990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9073f-6e69-4862-92ee-929169726ae6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.673824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4b28-180d-4033-b931-784cac6eb200 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.698322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.699246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.699561 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.699983 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.703594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:17.721973 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:17.729124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.729768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.730041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.730306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5f56217c-3e4b-4823-8861-51672fca39b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:17.730981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:17.732490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:19:17.733666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:17.734328 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:17.734443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 217/436] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:17.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:17.734683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42974-884d-4db7-9b1b-300b23c0cde1 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.734798 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42974-884d-4db7-9b1b-300b23c0cde1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.735389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e42974-884d-4db7-9b1b-300b23c0cde1 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.736074 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 220/437] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:17.741018 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 218/438] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:17.741184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.741278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e42974-884d-4db7-9b1b-300b23c0cde1 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.888273 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e42974-884d-4db7-9b1b-300b23c0cde1 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.924962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f907e1-4312-4418-81c9-858287265288 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:17.927807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.928667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.928941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.929213 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.929897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:17.930200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:17.931636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:17.942645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 219/439] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:17.943947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:17.974917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:17.975986 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:17.976448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:17.976913 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:17.987690 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.037669 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.072923 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.074472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.102715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da1f9e-82c2-41a5-9720-bd589fe137e2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.142858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.143853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.144169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.144437 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.145169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:18.145477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.147049 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1c6b-57f0-4352-97b2-204191acd8aa None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.153209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 220/440] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:18.154445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.154711 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.154970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.177693 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:18.179616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:18.226018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 221/441] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:18.226930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.300927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.327937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 221/442] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:18.327937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.405143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ca541-6d81-411b-8439-3894311620c1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.452542 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.458285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.459425 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.459858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.460165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.515229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1611d3-79a8-4112-9d73-905c6b794f03 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.561184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.562958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.566263 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.567321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.567780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.568428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] PATH_INFO: `/v3/projects/48610a2636e84d8bb583e7f9fa3a615d` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.570114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] RBAC: Authorizing `identity:get_project(project_id=48610a2636e84d8bb583e7f9fa3a615d)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.572475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.574903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 222/443] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/projects/48610a2636e84d8bb583e7f9fa3a615d => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:18.581244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.616130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.706779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 222/444] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:18.708558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.710452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16013-5fdc-441d-a79b-3780b670c198 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.738692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.758851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.759500 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.760047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.760047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.761393 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.762651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.764311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 223/445] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:18.765099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.857488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb942000-9c3b-4614-b6d9-2a8d9a980264 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.916335 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.917000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.917279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.917550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] PATH_INFO: `/v3/projects/7876a52b82454de19a81f60278c91be6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.918989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] RBAC: Authorizing `identity:get_project(project_id=7876a52b82454de19a81f60278c91be6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:18.920505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:18.921133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116e5a9-a4e7-4815-9722-70d1ba2bb38a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:18.922194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 223/446] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/projects/7876a52b82454de19a81f60278c91be6 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:18.922971 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:18.934370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:18.971338 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:18.971922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:18.972211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:18.972528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:18.994126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:19.000675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:19.001763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 224/447] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:19.002583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:19.053001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95543a04-1f8f-4043-9823-33af80a9151d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:19.062103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:19.091760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:19.092398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.092670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.092932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.093660 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=0df241ea8604447fb366198675e1711a, scope.project.id=48610a2636e84d8bb583e7f9fa3a615d) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:19.093958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:19.095477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:19.101708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 224/448] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:18 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=48610a2636e84d8bb583e7f9fa3a615d&role.id=0df241ea8604447fb366198675e1711a => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:19.102601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:19.160206 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f242e-530c-4713-b1f0-bb7ab67d9ccc None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:19.208714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:19.210586 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.210586 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.210821 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] PATH_INFO: `/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.213022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] RBAC: Authorizing `identity:get_group(group_id=cf6cfba062d34e5d848e1ff300fbec2a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:19.216074 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:19.219293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 225/449] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:19 2022] GET /identity/v3/groups/cf6cfba062d34e5d848e1ff300fbec2a => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:19.219851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:19.228989 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:19.268487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e2c66-1f9e-4c7a-95e6-e91ab3494651 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:19.323272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:19.323982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.324270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.324543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.325998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:19.325998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:19.327398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:19.338038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 225/450] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:19.344828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:19.419531 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452dafd-e7ba-4a0f-961c-232270a9d38c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:19.440005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:19.475073 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:19.475936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.476418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.476861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.478228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] RBAC: Adding query filter params (group.id=cf6cfba062d34e5d848e1ff300fbec2a, role.id=2cb849773c2647be9ff33d4efbb48203, scope.project.id=7876a52b82454de19a81f60278c91be6) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:19.478742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:19.481544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:19.482072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a53f-1c31-43ac-b4ca-99c307ee2343 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:19.489681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 226/451] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:19 2022] GET /identity/v3/role_assignments?group.id=cf6cfba062d34e5d848e1ff300fbec2a&scope.project.id=7876a52b82454de19a81f60278c91be6&role.id=2cb849773c2647be9ff33d4efbb48203 => generated 611 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:19.529801 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:19.537111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:19.537904 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.538379 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.538770 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.644195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:19.645699 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:19.794173 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 226/452] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:19.800836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:19.970817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6a3f-234b-4bd9-88ba-7ca1ea10b199 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:20.024367 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:20.025368 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.025751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.026162 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] PATH_INFO: `/v3/projects/44a6d06c119f40359a0b6c352385f165` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.027748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] RBAC: Authorizing `identity:get_project(project_id=44a6d06c119f40359a0b6c352385f165)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:20.029388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:20.031152 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 227/453] 10.222.0.75 () {56 vars in 1186 bytes} [Tue Aug 23 23:19:19 2022] GET /identity/v3/projects/44a6d06c119f40359a0b6c352385f165 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:20.037124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:20.090643 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:20.200474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd11396-72a5-4222-89a8-4b7bdb99d320 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:20.257967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:20.258746 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.259133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.259555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] PATH_INFO: `/v3/groups/1ec086848b234ae3b282fe8905552b6d` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.261368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] RBAC: Authorizing `identity:get_group(group_id=1ec086848b234ae3b282fe8905552b6d)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:20.262935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0052531-15c3-41ad-a710-71b8b2f66c39 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:20.265254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 227/454] 10.222.0.75 () {56 vars in 1180 bytes} [Tue Aug 23 23:19:20 2022] GET /identity/v3/groups/1ec086848b234ae3b282fe8905552b6d => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:20.271672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:20.343866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:20.425080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba019fd7-6099-4d21-8d7f-bd442d4c3be8 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:20.470626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:20.471755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.472073 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.472350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.473109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] RBAC: Adding query filter params (group.id=1ec086848b234ae3b282fe8905552b6d, role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=44a6d06c119f40359a0b6c352385f165) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:20.473406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:20.474903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aff1c-7ade-4493-aaaf-12be86f48aa7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:20.482254 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 228/455] 10.222.0.75 () {56 vars in 1376 bytes} [Tue Aug 23 23:19:20 2022] GET /identity/v3/role_assignments?group.id=1ec086848b234ae3b282fe8905552b6d&scope.project.id=44a6d06c119f40359a0b6c352385f165&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:23.886445 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11df1f-71ec-4436-afe4-1cce9f19ad41 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:23.887739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11df1f-71ec-4436-afe4-1cce9f19ad41 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:23.888436 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11df1f-71ec-4436-afe4-1cce9f19ad41 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:23.891287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 228/456] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:23.901283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea85-c7ea-457c-99a8-70e6f03850cb None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:23.902766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea85-c7ea-457c-99a8-70e6f03850cb None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:23.903481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea85-c7ea-457c-99a8-70e6f03850cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:23.932934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2b37ea85-c7ea-457c-99a8-70e6f03850cb None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:23.934980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2b37ea85-c7ea-457c-99a8-70e6f03850cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:24.065864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 229/457] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:24.285880 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043d12-0def-470f-85d0-1a34eefce5c6 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.286559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043d12-0def-470f-85d0-1a34eefce5c6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.287149 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19043d12-0def-470f-85d0-1a34eefce5c6 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.290186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 229/458] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:24.298592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a02f3-1b2d-4140-a358-01b2bbe09dd6 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.299432 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a02f3-1b2d-4140-a358-01b2bbe09dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.300182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a02f3-1b2d-4140-a358-01b2bbe09dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.330673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-b81a02f3-1b2d-4140-a358-01b2bbe09dd6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:24.333126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-b81a02f3-1b2d-4140-a358-01b2bbe09dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:24.402110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:24.459088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 230/459] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:24.525848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5cd6-3873-4910-b3a2-40a0a32d038d None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.526715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5cd6-3873-4910-b3a2-40a0a32d038d None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.527401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5cd6-3873-4910-b3a2-40a0a32d038d None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.530948 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 230/460] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:24.541039 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593241cd-0a3c-4308-a00d-c2e94989d0d2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.541714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593241cd-0a3c-4308-a00d-c2e94989d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.542386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593241cd-0a3c-4308-a00d-c2e94989d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.573000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-593241cd-0a3c-4308-a00d-c2e94989d0d2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:24.575428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-593241cd-0a3c-4308-a00d-c2e94989d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:24.599413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5cd6-3873-4910-b3a2-40a0a32d038d None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:24.703344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 231/461] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:24.724639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04dc4a-78cd-453b-a716-ce26524599ff None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.724639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04dc4a-78cd-453b-a716-ce26524599ff None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.725270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04dc4a-78cd-453b-a716-ce26524599ff None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.726994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 232/462] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:24.734644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.735258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.735813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.761293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:24.763312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:24.796998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:24.803790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5cd6-3873-4910-b3a2-40a0a32d038d None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:24.887538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:24.888644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:24.889027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:24.889322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:24.909764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:24.911671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:24.924590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 233/463] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:24.927933 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:24.938016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:24.939624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:24.941123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:24.941123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:24.941123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:24.941123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 231/464] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:24.947104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:24.982535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:25.073672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0de9-9af5-46f2-b6b5-6a2c0de4299a None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.125783 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f592dd-53b8-4b5e-b700-c05dd7db8c37 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.146564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.147752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.148336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.148828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.167676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.169209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:25.202403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:25.204314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:25.206010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:25.206010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.206010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:25.208103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 234/465] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:25.210336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:25.221965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.222823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.223218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.223671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.224888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:25.225341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.227833 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.265254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 232/466] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:25.265254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:25.303056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:25.408818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:25.446277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12f807-3466-4c8d-9a76-6b6b051a6bf5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.469580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67507-fe16-44b0-8e66-f24a7b9c9a7d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.515229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.516070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.516441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.516779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.532779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.534450 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.534952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.536067 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.536580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.537077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.538345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:25.538907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.541607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:25.558191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:25.560103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:25.561836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:25.561836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.561836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:25.564095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 235/467] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:25.565516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 233/468] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:25.565818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:25.567637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:25.698002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:25.744691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8db05-085a-44a0-8f51-108770699aa6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.753013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c989-0656-42c8-b6bc-71cde1f7bb17 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:25.799379 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.800515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.802361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.802748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.804204 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.806790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.817667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:25.818317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.818693 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.818974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.821102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:25.844176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:25.849226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:25.862925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 236/469] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:19:25 2022] POST /identity/v3/users => generated 246 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:19:25.864321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:25.897949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:25.901343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:25.902248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:25.902248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:25.902248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:25.902248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 234/470] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:25.903285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:26.098185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765975c-8559-4506-9525-e56e8db98909 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.105720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133e7a-58da-4618-881f-151849a8f754 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.145735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:26.177221 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.178366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.178823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.179309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.180303 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.182448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.182683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.183224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.183684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.184094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.184834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:26.187021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.187021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.216621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 235/471] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:19:25 2022] POST /identity/v3/users => generated 248 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:19:26.217503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:26.219075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 237/472] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:26.234773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:26.336907 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:26.424459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05ca79-b7c3-4980-9ba3-e431bc57d2d0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.433650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252793-4fec-408a-958c-92dcb1658ec0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.484614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.485650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.485958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.486368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.487133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:26.487509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.489412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.498328 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.499702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.500487 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.501167 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.502835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.506185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b778e75-13ae-4dd8-8ec4-1d8af823661f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.510514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 236/473] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:26.511592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:26.542508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 238/474] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:19:26 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:19:26.598720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:26.745272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06730dec-9a14-4a22-8e9b-2368e54e4b00 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.827953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.827953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.828380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.828521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.829722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.832580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4da6b-4db8-429a-bad4-fb81d05a9eff None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.873655 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 237/475] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:19:26 2022] POST /identity/v3/users => generated 249 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:19:29.037518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb4cc-3e59-4425-b7c6-06e288672e41 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.038109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb4cc-3e59-4425-b7c6-06e288672e41 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.038109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb4cc-3e59-4425-b7c6-06e288672e41 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.039995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 239/476] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:29.045940 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a60f-ed96-4f50-8915-83759eff60f2 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.046499 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a60f-ed96-4f50-8915-83759eff60f2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.046499 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a60f-ed96-4f50-8915-83759eff60f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.072724 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d3f8a60f-ed96-4f50-8915-83759eff60f2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:29.074684 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d3f8a60f-ed96-4f50-8915-83759eff60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.171822 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 238/477] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:29.526325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb4cc-3e59-4425-b7c6-06e288672e41 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:29.551042 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d8ad-52e6-4605-9339-acf9e7014d0a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.551399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d8ad-52e6-4605-9339-acf9e7014d0a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.551828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d8ad-52e6-4605-9339-acf9e7014d0a None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.554469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 239/478] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:29.561907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a669a-39d5-43cf-99ff-403cf1439e36 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.562265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a669a-39d5-43cf-99ff-403cf1439e36 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.562615 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a669a-39d5-43cf-99ff-403cf1439e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.586331 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-8c8a669a-39d5-43cf-99ff-403cf1439e36 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:29.587936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-8c8a669a-39d5-43cf-99ff-403cf1439e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.621432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:29.659711 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb4cc-3e59-4425-b7c6-06e288672e41 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:29.671410 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:29.688298 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 240/479] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:29.725836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:29.726595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.726883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.727321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.739006 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e966b-fdf6-459e-a26e-67ebb8986a6c None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.739632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e966b-fdf6-459e-a26e-67ebb8986a6c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.740293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e966b-fdf6-459e-a26e-67ebb8986a6c None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.743130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 241/480] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:29.743921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:29.745249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067cc61-c145-4706-b9ed-c6133ba185e9 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.745872 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067cc61-c145-4706-b9ed-c6133ba185e9 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.746416 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067cc61-c145-4706-b9ed-c6133ba185e9 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.747927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 242/481] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:29.749136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.749613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.750071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-f660874a-93c3-423e-9268-3bc6578eb3cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:29.751722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:29.752684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:29.753524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:29.754136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 240/482] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:29.754964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.755268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.755583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.774637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:29.775253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:29.775862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.776441 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.870895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 243/483] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:29.872646 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:29.893045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 241/484] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:30.008547 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.028887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c7fe9-0381-45d5-943a-2013406b9366 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.072985 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.073912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.073912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.074218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.074784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:30.075079 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.076874 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.088164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 244/485] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:30.094495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.106338 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.229427 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.237829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27d5c-4d5f-43dc-a0b6-4f8d33c6649a None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.246489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de977752-fa85-4a30-b84a-e1f362dc8391 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.285917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.286603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.287333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.287452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.292688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.293344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.293627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.293898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.299339 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.300892 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.306269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:30.312791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:30.314483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 245/486] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:19:30.315562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:30.321790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:30.323249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:30.324475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:30.324475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:30.324475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:30.324475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 242/487] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:30.324475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.332741 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.432162 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c301-dbdb-4763-803c-24859b0f3f3b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.439012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c566-c0c5-4ef9-a189-500b9e16623d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.478050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.478689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.478966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.479235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.480542 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.481109 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.481383 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.481649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.490326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:30.493583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:30.495897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:30.496874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:30.497675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 243/488] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:30.498980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:30.499047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:30.500372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 246/489] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:30.501152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.512855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.572965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.611673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b49422-7dcb-4b19-9f34-08f2f3ea313e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.617354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334176e-9de9-4965-9f66-f69965bccf4b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.646230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.647013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.647286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.647549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.648241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:30.648539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.649955 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.655215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.655837 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.656161 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.656435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.657119 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:30.657429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.658838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.662795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 247/490] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:30.663284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.667846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 244/491] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:30.668726 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.744053 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.779381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a79d1-2c14-4afd-a45d-0928716bda9d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.790775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e53f2-9c9f-4c68-aee1-65d02229196a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.817556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.818046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.818580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.819241 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.819602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:30.819970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.821318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.823670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.830371 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 245/492] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:30.831265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.837157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.837781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.838035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.838301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:30.838981 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:30.839284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:30.840715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:30.849774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 248/493] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:30.850867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:30.949555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6348e5c-cc61-4cc9-835c-0924b8b7a0a9 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.977680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f71a0-8b1a-49b3-a781-9a72e085dce7 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:30.985418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:30.992115 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:30.993802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:30.993802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:30.993802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.003017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.004437 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.015909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.016504 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.016817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.017248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:31.017978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:31.020429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 246/494] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:31.027069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.036439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.038038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:31.053469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:31.054468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:31.055302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:31.055302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.055302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:31.055302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 249/495] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:31.055302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.104984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.144738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de98908-1a63-454d-8a15-85792f00e4b5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.167375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3af66c-9074-4af5-bb0d-9b1195055db8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.181023 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.181656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.181933 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.182201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.193931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.195497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.202908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.203541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.203820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.204179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:31.210714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:31.211680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:31.212938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:31.212938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.212938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:31.212938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 247/496] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:31.212938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.218413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.219977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:31.235378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:31.236498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:31.237327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:31.237327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:31.237327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:31.237327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 250/497] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:31.238037 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.270083 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.332302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1df3d-94be-4aa4-9a24-1a2960ab5880 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.346907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.355107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ba55b-b273-42f6-9705-cda3e242eafa None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.369956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.370556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.370831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.371097 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.371827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:31.372176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.373628 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.395481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.396136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.396632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.396932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.397587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:31.397890 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.399271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.413325 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 251/498] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:31.414151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 248/499] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:31.414390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.415037 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.526837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4212c6-87ed-4adf-b2ff-17a1953e8714 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.527614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea6050-3908-44ba-b191-f6124e69f182 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.529311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.563093 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.563790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.564176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.564690 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.565107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:31.565409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.566503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.566787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.566903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.567064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.567333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.568038 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:31.569177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.570610 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.580629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 252/500] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:31.581652 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.589449 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 249/501] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:31.591442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.600398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.721510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca6f8-7c1e-49f3-8365-3d86916f0190 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.721982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b7474-ea88-413a-9aa0-601a3b60e858 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.763735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.764318 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.764488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.764818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.764958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.765148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.765306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.765432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.773632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.775202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:31.791614 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:31.794046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 250/502] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:31.795626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:31.828834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.858339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.860482 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:31.881034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:31.930577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f50b23-8a44-4213-b084-49814e13ed03 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:31.976664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:31.978378 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.979176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.979176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.989241 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:31.990858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:32.004936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:32.006196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 251/503] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:32.008317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.013520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 253/504] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:32.014258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.121580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.140639 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efedb5-549a-4223-9d81-ffc3e1a45f1b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.147896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59ef72-3a47-4687-9a2c-8e3f45ae3ddc None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.156976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.179999 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.180618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.180896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.181271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.181943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:32.182251 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.183738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.186861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.187497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.187772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.188156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.197477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.199384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:32.214672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:32.224170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 252/505] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:32.225885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.235751 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 254/506] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:32.236820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.354104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298f521-5b95-4f4c-a404-8a9a25175c85 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.364082 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca5f4-a484-4923-a4a6-447cb875de64 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.398590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.399145 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.399425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.399699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.407336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.408229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.408579 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.408957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.409894 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:32.410214 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.412016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.412817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.415035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.418372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.432573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 255/507] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:32.433480 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:32.437861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:32.438747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:32.439593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:32.439593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:32.439593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:32.439593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 253/508] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:32.440293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.474859 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.556736 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5ba8-8a02-469e-ab16-dfdd937314de None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.563959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f3c10-86d3-4d7f-89e1-99e13060cab2 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.596033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.596648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.596940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.597234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.605686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.606386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.607072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.607072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.607974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:32.608340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.610555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.633996 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 256/509] 10.222.0.75 () {56 vars in 1139 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:32.636477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.685829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.698381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.700434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.758798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.774594 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61610e4a-643b-4e6c-b563-687c3ab4a2ad None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.819156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.819985 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.820422 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.820715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.845971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 254/510] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:32.845971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.901876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.903411 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.950901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.959723 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00120ff0-56db-4369-9dd7-d5ced027ad2c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.998378 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.998995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.999278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.999556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.000315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:33.000544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.001948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.003914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.015510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 255/511] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:33.016424 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.023438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 257/512] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:33.023438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.136215 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71af7e-3c63-4fdb-a81d-daad73505cf8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.148128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af53df-190d-4c5d-9405-e6a15c81320b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.178937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.179790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.179945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.180173 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.191794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.192844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.193535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.193779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.193920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.194056 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:33.212101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:33.213256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:33.214301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:33.214301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.214301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:33.214301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 258/513] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:33.214301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.227697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.270604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.299635 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.301544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.342254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c308d26-fb95-4cd6-a3bc-03318acae86a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.379389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.380137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.380414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.380788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.393322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.394967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:33.413382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:33.414543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:33.415523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:33.415523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.415523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:33.415523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 259/514] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:33.415523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.419699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 256/515] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:33.420780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.486157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.530729 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.541414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990ac6-cca7-431c-b3fd-ce3df39550da None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.541831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdc823-3b5c-44e0-9bc4-424fe2807259 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.587589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.587868 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.588272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.588462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.588779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.588907 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.589000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.589070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.589834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:33.590033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.591511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.596599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.598308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.605170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 257/516] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:33.606359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:33.612184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:33.613206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 260/517] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:33.614224 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.728745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f2a9-bfcb-406b-ae9f-d83a34204e1e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.734820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d3e8-4e6b-4feb-852b-ba16d0a8a9ee None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.744088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.767731 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.768389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.768751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.769044 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.769703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:33.770005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.771694 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.777062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.777697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.777965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.778229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.784532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 258/518] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:33.785388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.794799 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.796501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:33.813317 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:33.814825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:33.815667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:33.815667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:33.815667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:33.815667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 261/519] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:33.815667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.824464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:33.906392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f43df-c088-443c-9d3e-ac38fca2a214 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.943830 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.944773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.945145 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.945429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.945968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14095a5c-896b-4eba-a474-ad46f910e879 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:33.953902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.955381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:33.968394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:33.969310 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 259/520] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:33.970435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:33.989723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:33.990373 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:33.990649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:33.990990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:33.991689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:33.992029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:33.993530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.020608 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 262/521] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.020787 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.020869 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.093327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.098436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e3bae-c983-424e-bab1-1716d7945c39 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.136890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.137504 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.137808 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.138080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.144478 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721af14d-4b95-47b5-95c4-25cb49b43829 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.147325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.148970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:34.162148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:34.163498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 260/522] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:34.164559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.190627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.191235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.191511 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.191773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.192478 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.192777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.194191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.206935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 263/523] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.207782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.283244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.292148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c36b6-b236-4565-8202-355534b6b538 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.329468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95657b-496f-4749-aa9b-4e4ca2626c66 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.334775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.335469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.335963 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.336199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.336951 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.337367 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.338849 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.355863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.361399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 261/524] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.362282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.374564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.375560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.375823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.376230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.377114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=c7b8c451555a48468abd236dad2d1f75) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.377421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.378956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.385655 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 264/525] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/role_assignments?user.id=c7b8c451555a48468abd236dad2d1f75&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.386549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.516704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ec32-c490-4b92-880a-061a06291584 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.555102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70aa7-7300-4baf-9c4e-a282ffefce99 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.568622 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.569930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.570278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.570645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.571538 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.571913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.573606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.590304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 262/526] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.591090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.605488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.606150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.606409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.606732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.614210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.614667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.617160 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:34.633792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:34.634927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 265/527] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:34.635772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.708591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.765974 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2b1d6-0c1b-4022-b710-12b3caae97ac None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.774752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02549efa-d1fd-4f2e-8b9a-74f005875f84 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:34.807841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.808503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.808799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.809148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.809947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=84548f065a0240e2b700b2c9eecb8bd7) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.810247 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.811799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.816680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:34.817650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.818300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.827138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.827437 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 263/528] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/role_assignments?user.id=84548f065a0240e2b700b2c9eecb8bd7&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.827557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=a4243bac39ca441498a5fc88927c6dea) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:34.827694 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.827797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:34.827797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:34.830288 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 266/529] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/role_assignments?user.id=a4243bac39ca441498a5fc88927c6dea&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:34.951426 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.974648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d5a2-25bd-460d-8bfb-6957e5db89d4 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:35.017858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:35.018562 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:35.018836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:35.019104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:35.019819 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:35.020157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:35.022416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7319e8-137e-40af-9d2e-2b758087836b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:35.044433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 264/530] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:35.048615 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:35.161139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8f70b-e068-4c82-aafd-cf293429ccb9 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:35.175200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:35.197741 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:35.198448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:35.198659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:35.198885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:35.199623 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=d0bad6d774424470a1556d5c4e1db12c) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:35.199965 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:35.201782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa42f02-aaf1-4f44-9ee0-42884287b7d7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:35.208509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 267/531] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:35 2022] GET /identity/v3/role_assignments?user.id=d0bad6d774424470a1556d5c4e1db12c&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:36.746467 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971e24-5334-4213-be39-77744406eb2f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:36.747035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971e24-5334-4213-be39-77744406eb2f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:36.747035 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971e24-5334-4213-be39-77744406eb2f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:36.748624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 265/532] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:36.754358 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab7d4-f9d7-4f4c-adc9-8012d981097e None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:36.754835 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab7d4-f9d7-4f4c-adc9-8012d981097e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:36.754911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab7d4-f9d7-4f4c-adc9-8012d981097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:36.776155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-415ab7d4-f9d7-4f4c-adc9-8012d981097e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:36.777402 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-415ab7d4-f9d7-4f4c-adc9-8012d981097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:36.871434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 268/533] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:37.276768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e971e24-5334-4213-be39-77744406eb2f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:37.300809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cde-f50c-468b-bee8-6f617ab1a3fc None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.301241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cde-f50c-468b-bee8-6f617ab1a3fc None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.301619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cde-f50c-468b-bee8-6f617ab1a3fc None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.303680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 269/534] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:37.310343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.310634 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.310902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.336240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:37.337491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:37.443992 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 270/535] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:37.452488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e971e24-5334-4213-be39-77744406eb2f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:37.497730 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:37.498373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.498689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.498994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.507091 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:37.511852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3a3c2a0a-85ff-4f80-81d5-46d83ad17e66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:37.516953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:37.518631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:37.520219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:37.523914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 266/536] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:37.525359 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:37.571914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:37.584552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4259-8399-426b-833a-18e8332f95d5 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.584971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4259-8399-426b-833a-18e8332f95d5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.585317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4259-8399-426b-833a-18e8332f95d5 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.587388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 267/537] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:37.592776 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.593418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.593861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.618389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:37.620695 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:37.668266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bf244-2ee3-4f52-be14-cb64fbf7abb8 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:37.727348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:37.728378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.729153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.729667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.730635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:37.731113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:37.732878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:37.741082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 268/538] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:37.747852 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 271/539] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:37.749331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:37.808255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:37.914338 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504f75f-8d9c-4174-9d85-1c3b5bb03ddf None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:37.951490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:37.963692 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:37.964293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:37.966154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.966909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.967348 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.969814 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68e1e-e999-4222-a27d-14ae41dea68d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:37.981150 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:37.983583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:38.003642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:38.004841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:38.005877 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:38.005877 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:38.005877 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:38.013102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 269/540] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:38.014810 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.034505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.035672 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.036287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.036853 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.059645 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:38.066885 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:38.068156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:38.069032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:38.069732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 272/541] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:38.079415 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.167177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f45e8-78cb-4ccd-bb1b-7edf6379ab8d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.228610 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.229225 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.229503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.229851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.230579 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:38.230721 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.232479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.236305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4690c-cc7e-40f5-a348-e0c8cce060ff None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.252545 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 270/542] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:38.253542 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.291901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.292494 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.292764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.293220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.294344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:38.294856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.297445 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d5f0a-c131-447d-bbc5-7c4b87ed5abc None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.311952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 273/543] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:38.318204 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45275-567b-4c80-921f-95f6f11828e7 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.318695 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45275-567b-4c80-921f-95f6f11828e7 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.319186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45275-567b-4c80-921f-95f6f11828e7 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.319588 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:38.322062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 274/544] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:38.323546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f45275-567b-4c80-921f-95f6f11828e7 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.359189 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:38.399408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773687d4-6a2a-4a1a-a806-23b64a7a7a84 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.440647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.441213 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.441492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.441768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.456109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:38.461080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:38.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:38.462841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:38.465409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 271/545] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:38.466451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.485168 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f45275-567b-4c80-921f-95f6f11828e7 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.553008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.554671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.555198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.555718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.567509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.569700 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e4a15113-2700-4efe-8529-9e86ea8b22ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:38.595548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:38.597611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 275/546] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.599612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.600941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.618295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:38.619547 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:38.627100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:38.631725 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58c698-83f6-46a9-8786-821fa1c2f744 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.676662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.677382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.677730 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.677916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.690864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.693596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:38.721896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:38.724124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:38.726306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:38.726306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:38.726306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:38.726306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 272/547] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:38.726306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.733278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 276/548] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:38.733278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:38.752768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:38.900372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a05bc-5acd-4063-9a63-8127815a3704 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.909514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043053bc-fd11-44d8-9e01-1b7f51cae8d5 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.961329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.962155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.962617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.963128 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.964394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:38.964882 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.965822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.966629 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.967065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.967459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.967553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.968586 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:38.969218 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.971405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.985483 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 273/549] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:38.986499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.011928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 277/550] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:39.011928 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.013166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.093677 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.135446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f95a0-9e19-4bb6-8c81-df5a54a2e6de None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.149944 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5ae8c-5c5b-4db8-bdf1-8cade41edd4f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.180602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.181521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.181986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.182488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.183503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:39.184055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.186618 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.200354 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.201551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.201939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.202301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.204185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 274/551] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:39.206270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.218584 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.220084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:39.236239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:39.239034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:39.241866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:39.241866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:39.241866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:39.241866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 278/552] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:39.241866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.325544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.362309 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894d31-10b1-45ad-b72c-30923c54a689 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.375662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b19d-ae93-47ef-b8d2-096f7968c14e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.402106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.403094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.404102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.404102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.406319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.419444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.421225 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.425019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.425664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.426040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.426208 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:39.437751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:39.439666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:39.441308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:39.441308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:39.441308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:39.441476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:39.441829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 275/553] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:39.442967 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:39.445207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:39.446481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:39.447658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 279/554] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:39.448858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.571958 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6be3d-77a5-4c9f-89d5-7125a38fd0a4 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.573035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab75fbc-5a09-4cef-a95b-c509943c94a9 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.600880 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.611046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.611686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.611997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.612289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.614390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.615698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.616010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.616286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.616954 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:39.617271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.618647 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.622046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.623514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.632684 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 280/555] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:39.633545 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:39.635594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:39.636557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 276/556] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:39.637941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.683661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.748568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b18ae-c134-4a5a-aaec-d7e26774723f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.758964 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31c031-9bfe-4cd7-b995-ab9edb7540f5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.791963 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.792580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.792853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.793121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.793783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:39.794088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.795462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.800117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.801104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.801104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.801308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.801902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:39.802239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.803739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.804306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 277/557] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:39.805144 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.820924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 281/558] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:39.821807 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:39.867308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.928565 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9528d8-171e-4cfc-80cc-ef01d2962e3b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.940103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:39.943894 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ade038-f55d-4eed-86c2-0e82b80aeb89 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:39.967045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.967696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.968008 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.968277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.978194 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.979666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.981851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:39.982489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:39.982819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:39.983194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:39.983970 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:39.984276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:39.985736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:39.992632 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:39.993812 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:39.995322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 278/559] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:39.996249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.007789 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 282/560] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:40.008698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.109561 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb76d-81f0-4821-9504-4b8933c464a5 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.122395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.139686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79b85-597f-4dc8-8f31-0583cec8afab None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.154744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.155397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.155678 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.155983 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.169668 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.171172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.186861 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:40.187446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:40.189228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:40.190374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:40.190374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.190374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:40.190563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.190563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.190563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.191016 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 279/561] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:40.191016 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.202431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.204072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:40.215722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:40.216781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:40.217763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 283/562] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:40.218240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.243708 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.315556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad156-3c08-4e94-9fb0-0a646406c94f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.347077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae83c-ea1a-4812-87dc-14354d263f8a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.353677 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.354296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.354573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.355270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.355603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:40.356100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.357492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.380271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 280/563] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:40.381028 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.388564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.389316 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.389670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.390020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.402713 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.403561 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.404202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:40.420947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:40.421998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:40.422982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:40.422982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.422982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:40.422982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 284/564] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:40.423212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.505083 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.505361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-39c6-4406-8f3a-0885889bc299 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.541689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cfe80-9305-4671-80af-6a07a0c5886c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.544165 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.544792 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.545079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.545345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.545995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:40.546300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.547690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.559772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 281/565] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:40.560663 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.583901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.584797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.585072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.585342 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.586039 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:40.586344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.587798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.600421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 285/566] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:40.601280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.652596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.678630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908b42a-566b-4c0d-83a8-99895e87b812 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.720608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.721241 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.721376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae51d2-b223-4fa7-b665-0cac8e5a7535 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.721472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.721769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.733286 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.734715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:40.751636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:40.752871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:40.753741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:40.753741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:40.753741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:40.753741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 282/567] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:40.753741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.767818 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.775085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.775839 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.776045 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.776351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.777008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:40.777306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.778717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.791438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 286/568] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:40.792339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.884689 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055920-1001-4a5a-8895-5b493531cd78 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.923384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:40.933593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.934308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.934571 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.934878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:40.945970 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1adc83-6df0-4a16-8c11-97f5eef5b6e7 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:40.947905 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:40.949411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:40.962200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:40.963282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 283/569] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:40.964250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:40.993406 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:40.994232 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:40.994572 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:40.994856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/c7b8c451555a48468abd236dad2d1f75/roles/d7d39f62fb0b46a3ab210be426db5d7a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.013279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=c7b8c451555a48468abd236dad2d1f75, role_id=d7d39f62fb0b46a3ab210be426db5d7a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.015798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.043923 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 287/570] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:19:40 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/c7b8c451555a48468abd236dad2d1f75/roles/d7d39f62fb0b46a3ab210be426db5d7a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:41.043923 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.092498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:41.122171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa61ac3-837a-463b-a71b-3bf135457c99 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.180862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.181786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.182265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.182731 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.183919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:41.184458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.187452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.205177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85660774-0ac9-4341-96df-b00ec1b92883 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.207423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 284/571] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:41.210696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.266778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.267968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.268411 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.268847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.271204 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:41.291363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.294007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:41.314574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:41.316719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 288/572] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:41.318389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.355649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee9ca-42b1-4a20-9839-35f7f964f263 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.412792 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.413733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.414169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.414606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.415957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:41.416458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.419007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.457796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 285/573] 10.222.0.75 () {56 vars in 1139 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:41.460484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.480611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:41.485003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d70f2-49ac-45fd-93d2-fd833761e3e3 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.535859 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.537811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.538164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.538570 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.549732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.551936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:41.572723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:41.573688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:41.574718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:41.580249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 289/574] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:41.581479 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.640088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7958-6e8c-4d40-a971-d0618c544b72 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.659572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:41.702996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.704055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.704323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.704727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.705441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:41.705746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.707219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.732025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 286/575] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:41.732025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.762016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005fb2-a823-44ed-9ecf-d7fc1ba27641 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.807177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.807813 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.808253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.808396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.823679 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.825193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:41.844306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:41.850671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:41.852005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:41.852005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:41.852005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:41.852005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 290/576] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:41.852005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:41.867388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:41.880349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e4ac9-7d2b-483c-9596-d98bee87d123 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:41.929526 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:41.930702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:41.930702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:41.931227 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:41.932210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:41.932804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:41.935270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:41.955595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 287/577] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:41.956799 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:42.000577 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:42.021988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6030-469a-46b5-8789-aa48610215c3 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:42.094861 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:42.096029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:42.096458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:42.096945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/84548f065a0240e2b700b2c9eecb8bd7/roles/d7d39f62fb0b46a3ab210be426db5d7a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:42.115497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d95c-eacf-4af5-ab2e-a1f2bbf04629 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:42.116671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=84548f065a0240e2b700b2c9eecb8bd7, role_id=d7d39f62fb0b46a3ab210be426db5d7a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:42.118195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:42.136197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 291/578] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:19:41 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/84548f065a0240e2b700b2c9eecb8bd7/roles/d7d39f62fb0b46a3ab210be426db5d7a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:42.145223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:42.178875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b77-13af-488c-a89d-7009da882503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:42.181268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b77-13af-488c-a89d-7009da882503 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:42.182192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b77-13af-488c-a89d-7009da882503 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:42.182933 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714b77-13af-488c-a89d-7009da882503 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:42.184451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714b77-13af-488c-a89d-7009da882503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:42.185289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714b77-13af-488c-a89d-7009da882503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:42.189275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714b77-13af-488c-a89d-7009da882503 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:42.214491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 288/579] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:42.220364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b77-13af-488c-a89d-7009da882503 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:42.268320 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:42.339475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4630e6-69d8-4c02-b518-9aca50ae1506 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:42.390054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:42.391097 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:42.391528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:42.391981 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/a4243bac39ca441498a5fc88927c6dea/roles/d7d39f62fb0b46a3ab210be426db5d7a` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:42.414052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=a4243bac39ca441498a5fc88927c6dea, role_id=d7d39f62fb0b46a3ab210be426db5d7a)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:42.416333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:42.423389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:42.454326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714b77-13af-488c-a89d-7009da882503 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:42.459900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 292/580] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:19:42 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/a4243bac39ca441498a5fc88927c6dea/roles/d7d39f62fb0b46a3ab210be426db5d7a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:42.503323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:42.504333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:42.504908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:42.505831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:42.514931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:42.516984 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:42.532168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:42.533384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:42.534405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:42.537314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 289/581] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:42.543972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:42.738781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6300-f6d5-485a-8ad2-195026a6ce00 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:42.770333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:42.803845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:42.811914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d9a7-40c2-4705-ae5d-99c47357d846 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:42.834606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 293/582] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:42.839258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:43.007344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50526f91-678d-4198-89bf-0c2ca070be6b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:43.050947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:43.052396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:43.053959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:43.054785 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/d0bad6d774424470a1556d5c4e1db12c/roles/d7d39f62fb0b46a3ab210be426db5d7a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:43.093283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=d0bad6d774424470a1556d5c4e1db12c, role_id=d7d39f62fb0b46a3ab210be426db5d7a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:43.095786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8a232-4619-42c0-9e0b-2cdd99ce60be None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:43.111477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:43.121901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 290/583] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:19:42 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/d0bad6d774424470a1556d5c4e1db12c/roles/d7d39f62fb0b46a3ab210be426db5d7a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:19:43.700176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe507f-206d-4c93-bb0c-99a2f9d84c3c None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:43.701216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe507f-206d-4c93-bb0c-99a2f9d84c3c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:43.701216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe507f-206d-4c93-bb0c-99a2f9d84c3c None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:43.702876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 294/584] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:43.708953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:43.709434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:43.709715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:43.736585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:43.737858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:43.836026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 291/585] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:44.189287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe507f-206d-4c93-bb0c-99a2f9d84c3c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:44.328830 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe507f-206d-4c93-bb0c-99a2f9d84c3c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:44.366378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:44.367034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:44.367412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:44.367688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:44.380575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:44.385532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:44.386432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:44.387278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:44.391759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 295/586] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:44.393809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:44.540443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d3cae-0798-4fcb-96aa-10440145e0ca None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:44.580303 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:44.585656 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:44.586301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:44.586584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:44.586877 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:44.587789 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:44.588133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:44.589566 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:44.601528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 292/587] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:44.607776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:44.653472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:44.721828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d7f3c-cdd9-45c9-ac7c-267b3b412897 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:44.774111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:44.774823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:44.775101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:44.775375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:44.787486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:44.789056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:44.805559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:44.806973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:44.808099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:44.808099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:44.808099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:44.811698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 296/588] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:44.813582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:44.945970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e98-1936-4f10-bef5-5e985d0e78d9 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:44.994682 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:44.995529 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:44.995925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:44.996296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:44.997178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:44.997605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:44.999420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e218596-5c5b-45a3-9ae6-fe646ab58579 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:45.027218 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 293/589] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:45.029175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:45.087064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ff37e-700a-459c-a0ee-0f5949584756 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.087064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ff37e-700a-459c-a0ee-0f5949584756 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.089774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ff37e-700a-459c-a0ee-0f5949584756 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.089774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 294/590] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:45.099567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.100509 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.101234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.125441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:45.127119 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:45.139723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:45.166823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356a486-4179-44ea-8cd1-446e2707c325 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:45.199037 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:45.230352 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:45.231895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.232488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.233081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.234196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 295/591] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:45.251749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:45.253731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-305f1d9a-4294-4ba7-9365-f4839d6ebf60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:45.268535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:45.269710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:45.271005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:45.279012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 297/592] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:19:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:45.280871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:45.405098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d502b0-640c-4a04-a61f-b019d27f1118 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:45.442727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9679f-7542-4b10-bb0e-16cbeb5edbf6 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.443101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9679f-7542-4b10-bb0e-16cbeb5edbf6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.443351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9679f-7542-4b10-bb0e-16cbeb5edbf6 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.445345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 298/593] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:45.452206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.452520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.452787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.453639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:45.454372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.454714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.455055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.455815 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:45.456279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:45.458559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:45.475042 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:45.476278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:45.487981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 296/594] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:19:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:45.493837 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:45.554780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:45.587990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 299/595] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:45.589239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:45.635724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96a79c-54e5-465d-bc6c-5c9a8c546b04 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:45.678585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:45.679109 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.679379 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.679643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.692176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:45.728099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6ef8c-1c33-4a2e-9300-03808af777a8 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:45.767514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:45.768207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.768487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.768760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.769251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:45.771635 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8cba7-c8f4-4a15-b50e-ec3d5a26c6dc None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:45.783019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-0d4c8036-a416-4897-9d71-bbf1b659f1cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:45.787969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:45.789051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 300/596] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:45.795619 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011edf4-4a2e-49fb-b78d-120c9792534f None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.796900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011edf4-4a2e-49fb-b78d-120c9792534f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.796900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011edf4-4a2e-49fb-b78d-120c9792534f None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.796900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 301/597] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:45.796900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011edf4-4a2e-49fb-b78d-120c9792534f None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:45.848306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:45.934110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 297/598] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:45.935927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:45.936493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:45.937135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:45.961196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:45.962406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:45.979379 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011edf4-4a2e-49fb-b78d-120c9792534f None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.024577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.025536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.025822 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.026124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.026766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:46.027066 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.028489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:46.030076 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.039022 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 302/599] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:46.040198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.059491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 298/600] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:46.060664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.189808 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.218888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aabb8-3549-47e3-9518-79eb31d74bea None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.268673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4266fc4-b872-4212-94b6-47aafebdcfe1 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.283268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.289614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.289614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.289614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.305975 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.307967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:46.327650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:46.329587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:46.333036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:46.333036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:46.333036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:46.333036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 303/601] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:46.336064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.353475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.354603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.354603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.354874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.369685 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:46.374699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:46.376587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 299/602] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:46.378606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.415988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.500539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cee0-16d6-4bcb-802f-848dbfeeb7d5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.501032 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4207e1-45be-49aa-a5d5-c013310723d0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.538273 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.545383 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.546019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.546375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.546648 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.547295 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.547936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.548210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.548489 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.549177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:46.549441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.551048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:46.561361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.562832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:46.566991 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 300/603] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:46.568123 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:46.581229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:46.582349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:46.583488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:46.583488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:46.583488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:46.583488 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 304/604] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:46.583760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.716369 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287108f2-ce90-4ce2-93e1-250206a7ed58 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.722340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.726431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a3395-57be-4ae1-99a7-dbbcac516a38 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.761643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.762214 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.762482 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.762752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.763423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:46.763718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.765252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:46.770467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.771069 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.771386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.771662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.775153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 301/605] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:46.776031 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.783798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:46.789727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:46.791225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:46.792351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 305/606] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:46.793177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:46.857823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:46.938382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ae440-0b62-4b4d-befe-37e8ce7e9df2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.968382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ab8eb-da1e-4d91-8766-e249b3fe86c1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:46.983094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:46.983750 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:46.984141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:46.984441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:46.992531 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:46.994141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:47.007300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:47.009199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 302/607] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:47.010782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.023168 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.024028 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.024395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.024559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.025438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.025742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.027324 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.046927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 306/608] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.048137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.083015 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.157491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04858f-4394-4b1f-8a19-f1f3ce0bfcee None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.171175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.212198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b0be7-769c-4158-90fa-9397939e3be1 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.220674 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.221908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.222238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.222730 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.244169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.247118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.257972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.258596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.258872 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.259142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.259820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.260153 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.261565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.271086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 307/609] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.271836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:47.275385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:47.276630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:47.277692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:47.277692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:47.277692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:47.278530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 303/610] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:47.279626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.401511 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.424896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9294f85-85e2-4b79-bd67-ae96e759177e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.440012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b86c6-f8dd-49c2-be27-5ee838638d82 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.472410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.473025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.473297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.473617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.474404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.474701 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.476188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.482191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.482834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.483111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.483393 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.491043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 308/611] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.491941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.492981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.494475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:47.512332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:47.513878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:47.514823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 304/612] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:47.516343 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.556417 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.642741 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9647af-5a6a-4ae1-8503-d71eaac3782a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.659183 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e55da-4a8b-448a-ad82-14053a1785a7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.682234 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.683010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.683265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.683536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.696272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.697797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.700247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.705576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8263319-ef55-4213-b783-382916626919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.706312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8263319-ef55-4213-b783-382916626919 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.707077 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8263319-ef55-4213-b783-382916626919 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.707552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8263319-ef55-4213-b783-382916626919 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.708489 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8263319-ef55-4213-b783-382916626919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.708883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8263319-ef55-4213-b783-382916626919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.710427 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8263319-ef55-4213-b783-382916626919 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:47.715909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:47.717095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:47.718170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:47.718170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:47.718170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:47.720055 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 309/613] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:47.721203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.725792 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 305/614] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.727202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8263319-ef55-4213-b783-382916626919 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.841061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:47.866188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca12e-62f7-405f-a85b-834f2d858cee None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.870951 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8263319-ef55-4213-b783-382916626919 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:47.918796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.919417 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.919746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.920050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.920797 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.921128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.922655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.926141 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:47.926886 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:47.927169 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:47.927487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:47.928728 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=c7b8c451555a48468abd236dad2d1f75) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:47.929140 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:47.930977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:47.939309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 310/615] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/role_assignments?user.id=c7b8c451555a48468abd236dad2d1f75&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.940442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:47.946997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 306/616] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:47.948247 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.047680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.108737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71f18d-2f4f-4d96-b838-a659306191c7 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.114928 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dbb7e-b148-4ce9-96de-f7da6c35abbe None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.157744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.158495 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.158670 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.158925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.159566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:48.160537 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.162278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.173062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.173894 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.174187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.174506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.179003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 311/617] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:48.181297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.187071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.189126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.195816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:48.218304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:48.219666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:19:48.221120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:48.222163 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 307/618] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:48.222941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.335991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932377-141f-47e8-9160-f2f516e1bd56 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.360199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.364174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd5ea8-3d01-40ad-8437-264d12d6b164 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.384467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.385092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.385458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.385758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.406082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.406720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.406997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.407289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.416400 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.417875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:48.431179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:48.432284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:19:48.433515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:48.437194 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 308/619] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:48.438079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.470395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.471866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.509538 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.567679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172abf6-2f56-4ba8-a40e-5ddbfb942aaf None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.614311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 312/620] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:48.615293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.633020 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.633680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.633989 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.634348 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.635146 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:48.635460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.637395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.640476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.665957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 309/621] 10.222.0.75 () {56 vars in 1137 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:48.666852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.764807 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef1f6-9bb5-4f13-b0be-9a4859b1bd3d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.814677 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20591ce-d6e3-4815-b095-6b33f21b4d91 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:48.823988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.825060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.825984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.826473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.827777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:48.828382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.830840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.849415 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.858517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 313/622] 10.222.0.75 () {56 vars in 1139 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:48.859400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.879027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:48.879667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:48.880008 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:48.880311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:48.891543 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:48.893067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:48.909272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:48.910931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:48.912418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:48.912418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:48.912418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:48.912418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 310/623] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:48.912418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:48.978124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa58085-a3aa-4a1c-adae-7ecdafa6bcc0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.070524 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c560-960a-40a7-8068-35723758187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.071533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c560-960a-40a7-8068-35723758187a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.071817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c560-960a-40a7-8068-35723758187a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.072119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c560-960a-40a7-8068-35723758187a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.086944 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db606ad-cd16-4c3c-b3a2-c2fa58913109 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.137392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.137925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.138217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.138468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.177579 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c560-960a-40a7-8068-35723758187a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.179442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c560-960a-40a7-8068-35723758187a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.201594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.244069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.245788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.313696 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.350764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 314/624] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:49.351910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c560-960a-40a7-8068-35723758187a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.394748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 311/625] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:49.396037 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.485508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.489121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c560-960a-40a7-8068-35723758187a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.523173 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2edd9b-47a6-4a5c-ad81-27263d9b9e5f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.532518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.533129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.533405 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.533668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.534319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:49.534611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.536114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.548903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 315/626] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:49.549862 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.570053 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.570690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.570969 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.571237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.585418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.587275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.597549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:49.604631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:49.605643 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:49.606553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:49.606553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:49.606553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:49.606553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 312/627] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:49.606553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.704652 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556adfba-4624-40dc-8907-be30ebc63d3c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.756160 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.757103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.757368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.757774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.768908 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc084-4094-45a8-afde-f50e186f1118 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:49.773987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.776129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:49.793720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:49.795566 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:49.797642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:49.797642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:49.797642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:49.797642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 316/628] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:49.797642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.807469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.829502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:49.830937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:49.831636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:49.832120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:49.840242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:49.841986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:49.857388 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:49.858445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:49.859320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 313/629] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:49.859811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:49.952804 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:49.973458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ebd9-dab8-44c8-8232-7f16f24c0870 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.022474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.023228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.023456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.023644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.024324 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.024618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.026106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.039892 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71538774-272e-4edb-bea5-18d9a1c91413 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.045147 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 317/630] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.046227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.084395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.085420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.085842 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.086305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.087444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.088062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.090533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.105941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 314/631] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.106747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.161514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.178336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67bbc-246f-45a8-a38d-d63b59a0193b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.218194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.218897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.219207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.219377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.220081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.220392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.221950 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.235056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 318/632] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.235829 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.250194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.257584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1d984-2ecb-414d-aad8-cec5b231c7d0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.308681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.309334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.309630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.309959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.321432 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.323033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:50.336604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:50.337563 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:50.338440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 315/633] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:50.340734 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.379486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cfa15-f339-46b5-9489-f4c303b1dfe0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.424827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.425499 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.425797 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.426145 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.434254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.435821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:50.448403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:50.449490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 319/634] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:50.451094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.476781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea7a7-a1f2-45c4-b4a1-29c7809b9030 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.478418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.518495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.519003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.519281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.519549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.520411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=84548f065a0240e2b700b2c9eecb8bd7) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.521304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.522761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.526557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.538184 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 316/635] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/role_assignments?user.id=84548f065a0240e2b700b2c9eecb8bd7&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.538184 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.583892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0128e-6c3f-4d23-9c4d-223fc647a015 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.634500 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.635179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.635945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.636320 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.637130 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.637531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.639110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1490f5-aaae-4e6e-a10f-367f0e53bbd7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.659502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 320/636] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.659502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc27d7-5f18-431e-a109-1179b8c84c84 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.659502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc27d7-5f18-431e-a109-1179b8c84c84 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.659502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc27d7-5f18-431e-a109-1179b8c84c84 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.659502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 321/637] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:50.664737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc27d7-5f18-431e-a109-1179b8c84c84 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.683250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7325f7-38cd-4f31-863a-4fb2a19aff6d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.744910 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.745133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.745494 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.745758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.746459 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.747588 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.749088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01ac9e-13b8-49b5-bbd2-f93478f7cb15 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.767228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 317/638] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.768760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.768889 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.769384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.791392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:50.793655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:50.813884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc27d7-5f18-431e-a109-1179b8c84c84 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:50.822017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.844752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:50.854698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:50.855306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:50.855585 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:50.855925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:50.856705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=a4243bac39ca441498a5fc88927c6dea) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:50.857012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:50.858472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:50.865166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 322/639] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/role_assignments?user.id=a4243bac39ca441498a5fc88927c6dea&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:50.869150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:50.878978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 318/640] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:51.006226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006485-748b-4c44-8d6e-7f5c25a3c42a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:51.048065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:51.048723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:51.048969 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:51.049176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:51.049921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=d0bad6d774424470a1556d5c4e1db12c) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:51.050252 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:51.052731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:51.060103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 323/641] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:50 2022] GET /identity/v3/role_assignments?user.id=d0bad6d774424470a1556d5c4e1db12c&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:51.256781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:51.379491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36beef-eb5c-4b88-85c0-eb9619783d38 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:51.416068 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:51.416709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:51.416987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:51.417307 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:51.428402 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:51.433293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:51.434322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:51.435637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 319/642] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:51.441035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:51.520042 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:51.580875 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1964aa-17d1-4736-b2be-57eda7b97040 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:51.616419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:51.617043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:51.617321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:51.617593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:51.618274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:51.618578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:51.620005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:51.630194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 324/643] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:51.636220 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:51.660964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:51.758312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237885-b44c-4cf4-a076-8526edf6dcaa None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:51.795788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:51.796448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:51.796729 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:51.797005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:51.807915 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:51.809391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:51.824431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:51.827057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:51.829187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:51.829187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:51.829187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:51.829187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 320/644] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:51.833150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:51.944299 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537e81-7c54-4414-8d22-88be173e7397 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:51.962730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:51.987005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:51.987687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:51.987993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:51.988261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:51.988973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:51.989275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:51.990789 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:52.004292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 325/645] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:52.011172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:52.084919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:52.126601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888c0c-9124-4f0e-96cb-3955666e886a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:52.166885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:52.167524 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:52.167830 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:52.168102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:52.176393 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:52.177898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:52.190026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:52.191095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:52.192177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 321/646] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:19:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:52.202525 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:52.326409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af17b4-968c-4def-927b-285963d225f8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:52.363552 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:52.364241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:52.364522 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:52.364795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:52.365530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:52.365838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:52.367294 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:52.386428 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 326/647] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:19:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:52.392108 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:52.518156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7121ac-9f5d-4059-a8ad-f289d338f961 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:52.546556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:52.556148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:52.556842 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:52.557477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:52.557754 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:52.631900 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:52.633441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:52.740406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 322/648] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:19:52.749013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:52.786683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:52.868346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f4b9-b8ac-4533-9452-fc248640a9aa None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:52.906806 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:52.907457 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:52.907732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:52.908032 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:52.919383 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:52.920888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:52.937404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:52.938413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:52.939311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:52.939311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:52.939311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:52.939311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 327/649] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:52.949237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:52.982590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:53.073768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0476b-b9db-4ce0-8beb-df7a67374ab7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.117399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:53.118044 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.118323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.118591 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.119270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:53.119573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:53.121054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a144c-a1ef-490f-a8c8-94b5565745fb None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:53.135768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 323/650] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:53.145106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:53.153902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ff19-e785-4e03-9494-3f6fca253e72 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.154274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ff19-e785-4e03-9494-3f6fca253e72 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.154587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97ff19-e785-4e03-9494-3f6fca253e72 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.158138 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 324/651] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:53.168133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1207c4-edb7-4bb5-977c-ce3921ac2c25 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.168457 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1207c4-edb7-4bb5-977c-ce3921ac2c25 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.168685 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1207c4-edb7-4bb5-977c-ce3921ac2c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.194220 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ed1207c4-edb7-4bb5-977c-ce3921ac2c25 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:53.196453 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ed1207c4-edb7-4bb5-977c-ce3921ac2c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:53.269114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:53.288142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b353f88-9776-434c-83d8-28da96da4481 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.305187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 325/652] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:53.306575 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c39fea-f7a9-4fc7-b629-0cf15ad2d156 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.306922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c39fea-f7a9-4fc7-b629-0cf15ad2d156 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.307256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c39fea-f7a9-4fc7-b629-0cf15ad2d156 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.313249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 326/653] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:53.314537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.314884 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.315347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.334158 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:53.334795 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.335132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.335463 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.337342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:53.338791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:53.342961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:53.344473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:53.355570 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:53.358945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:53.359858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:53.360785 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:53.365627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 328/654] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:53.366567 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:53.432676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 327/655] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:53.497884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0329d-b204-437b-9b51-ac6763cceba0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.540430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:53.541418 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.541898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.542421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.543321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:53.543824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:53.545616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261e6df-35e4-4e05-b9bd-bf8850fe2dc5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:53.561754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 329/656] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:53.568089 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:53.683751 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1488-1e59-4b11-846f-ad4f88367608 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.684148 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1488-1e59-4b11-846f-ad4f88367608 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.684367 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1488-1e59-4b11-846f-ad4f88367608 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.685796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 330/657] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:53.691303 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.691594 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.692186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.692417 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e840b-2fb2-4fcb-a858-40352758854c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.715939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:53.717908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:53.720217 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:53.745998 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:53.746606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.746879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.747140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.747867 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=c7b8c451555a48468abd236dad2d1f75) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:53.748204 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:53.749633 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:53.758349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 328/658] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:19:53 2022] GET /identity/v3/role_assignments?user.id=c7b8c451555a48468abd236dad2d1f75&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:53.758349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:53.778244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:53.848308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 331/659] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:19:53.849179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:53.935853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c631dc-9fb7-46bf-963f-8e3f043247de None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.979351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:53.980231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:53.980613 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:53.981022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] PATH_INFO: `/v3/services/image` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:53.981719 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:53.983221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:53.995255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cd3e9-6593-45d8-9bff-798358c7a2c1 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:53.995465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:53.996469 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:53.997302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 329/660] 10.222.0.75 () {56 vars in 1105 bytes} [Tue Aug 23 23:19:53 2022] GET /identity/v3/services/image => generated 86 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:54.002712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.045013 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.046050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.046530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.046998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.047789 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.050256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:54.065798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:54.066938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:19:54.067993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:54.071006 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 332/661] 10.222.0.75 () {56 vars in 1129 bytes} [Tue Aug 23 23:19:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:54.075339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.084243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.097387 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.127675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb899e-83ad-4883-9c17-8b02d5090ee3 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.179409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.179409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.179409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.179409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.179800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.179800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.179800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.189931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 330/662] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:19:54.191086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.222561 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd3af7-fa99-4eaa-869e-b803171c86f0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.272607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.273328 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.273598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.273766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.274382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.274683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.276120 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.289486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 333/663] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:54.289486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.356093 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4757-61b0-412d-b18b-3ab624e424b2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.378543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.400072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.401059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.401480 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.401932 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] PATH_INFO: `/v3/services/network` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.402768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.404504 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:54.415697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:54.416839 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:54.417681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 331/664] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:19:54.418518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.425507 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.429731 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb6ea4-2a4a-442c-b107-591acfd35dc4 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.473075 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.473911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.473911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.474137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.474860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] RBAC: Adding query filter params (type=image) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.475117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.476586 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.483525 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 334/665] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:54.485071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.552865 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9b14-50c2-48bc-a8fc-00284f0fb6bc None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.607355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.608980 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.609513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.610063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.611928 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.612344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.614237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.626513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 332/666] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:54.639990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd92a-3f53-49a2-bbc2-afe30a405212 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.677908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.684477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.685103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.685374 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.685641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.686332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.686781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.688368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3e68-8cee-49a1-b182-765396cde6d8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.694429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 335/667] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:54.701892 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:54.797661 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:54.846542 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede2b3-c68d-4205-864f-7d5376f0c189 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:54.905153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:54.905840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:54.906133 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:54.906407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:54.907067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:54.907372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:54.909203 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000cbb-12f6-40bf-ba9b-07ef5d7e90c1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:54.920031 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 333/668] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:19:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:56.109056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbd86-080a-419f-a3f4-250085d5533f None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:56.109637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbd86-080a-419f-a3f4-250085d5533f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:56.109637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbd86-080a-419f-a3f4-250085d5533f None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:56.111506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 336/669] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:56.117359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:56.117835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:56.117911 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:56.143046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:56.144292 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:56.221448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 334/670] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:56.565406 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dbd86-080a-419f-a3f4-250085d5533f None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:56.681791 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dbd86-080a-419f-a3f4-250085d5533f None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:56.720811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:56.721453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:56.721726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:56.721988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:56.733993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:19:56.739307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:56.740272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:56.741117 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 337/671] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:56.748213 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:56.823216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:56.875188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fe36-f1f4-4dbf-a8d6-fc53cd00e5d6 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:56.913362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:56.913986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:56.914266 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:56.914540 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:56.915224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:56.915529 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:56.916977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f794fd-f4c6-4532-9f18-9d228b0e36cc None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:56.928447 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 335/672] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:56.934104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:56.985622 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe417-0447-4aa0-96ab-8068e200e202 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:56.986377 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe417-0447-4aa0-96ab-8068e200e202 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:56.986846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe417-0447-4aa0-96ab-8068e200e202 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:56.991166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 336/673] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:56.995357 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.001066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.001624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.002084 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.023332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:57.025043 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:57.053092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b478b-96f3-4c39-8f1d-3ee167969b56 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.103736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567695e-025f-4923-ad66-2a862395939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.104680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567695e-025f-4923-ad66-2a862395939e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.105110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567695e-025f-4923-ad66-2a862395939e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.105817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567695e-025f-4923-ad66-2a862395939e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.115328 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 337/674] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:57.125172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567695e-025f-4923-ad66-2a862395939e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.126749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567695e-025f-4923-ad66-2a862395939e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-3567695e-025f-4923-ad66-2a862395939e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:57.142286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:57.143293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:57.144226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:57.144226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:57.144226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:57.144226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 338/675] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:57.151374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.222769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.237786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df4f-1411-4384-82fb-321c83136c2c None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.238080 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df4f-1411-4384-82fb-321c83136c2c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.238360 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df4f-1411-4384-82fb-321c83136c2c None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.240879 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 339/676] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:19:57.242151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc7ab6-8f36-4476-be27-613f34732f22 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.242266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc7ab6-8f36-4476-be27-613f34732f22 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.242539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc7ab6-8f36-4476-be27-613f34732f22 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.244003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 340/677] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:19:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:19:57.249152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.249410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.249802 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.269143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:57.270505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:57.275095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92674f-1a1b-4682-afe0-715890a2454d None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.319367 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.320010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.320297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.320733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.321409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:57.321713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.323096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64bdc8-a018-46b9-ac14-fd46a7a4b742 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.335957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 338/678] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:57.337127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.337416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.337693 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.360667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:57.361851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:57.364443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 341/679] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:57.368851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.421632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.447511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 339/680] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:19:57.490010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.500375 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d440-1213-4c34-b8df-809fd5052099 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.546325 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.547893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.548253 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.548973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.549548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.560264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.562529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:19:57.579749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:57.580809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:19:57.581838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:19:57.588943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 342/681] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:57.590330 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.620106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d835e8-c9c7-40f2-b6f2-cfda0ca06503 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.666740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.667986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.668440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.668874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.670390 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.672243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.693153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 340/682] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:19:57 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:19:57.724422 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.732235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fad61-04c3-49c5-9921-d76cd9632524 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.733199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.789814 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.791237 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.791662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.792100 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.793010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:57.793496 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.796215 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.826539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 343/683] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:57.826539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.873786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc5eb5-abb4-4e52-9254-258c5f4af2e1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:57.877786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:57.940433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:57.941913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:57.941913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:57.941913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:57.942788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:57.944333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:57.967921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 341/684] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:19:57 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:19:57.967921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:57.976084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49efc2c-f3b3-4226-ba6d-4e63c34d89ba None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:58.038226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784154d-9854-47a3-931e-a2125278171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:58.039021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784154d-9854-47a3-931e-a2125278171c None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:58.039377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784154d-9854-47a3-931e-a2125278171c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:58.039701 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784154d-9854-47a3-931e-a2125278171c None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:58.040521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784154d-9854-47a3-931e-a2125278171c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:58.042413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784154d-9854-47a3-931e-a2125278171c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:58.065195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 344/685] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:19:57 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:19:58.117403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02a9-3279-4191-be04-a48757d70f6f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:58.180636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:58.181652 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:58.181652 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:58.181903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:58.196625 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:58.198260 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:19:58.217380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:58.220025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:19:58.222271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:19:58.222271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:19:58.222271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:58.222271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 342/686] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:58.227134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784154d-9854-47a3-931e-a2125278171c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:58.235770 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:58.372865 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784154d-9854-47a3-931e-a2125278171c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:58.424397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:58.425025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:58.425305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:58.425575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:58.426448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:58.426862 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:58.428484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:58.444538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 345/687] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:58.451143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:58.472651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:58.578587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d54b-ea47-40c7-9f75-de7a300becb2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:58.618755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:58.619919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:58.620619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:58.621274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:58.633228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:58.635848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:19:58.650106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:19:58.651272 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:19:58.652411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:19:58.654878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 343/688] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:19:58.661056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:58.734612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:58.774685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e064-0b12-4571-8833-e7331c85bb41 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:58.818006 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:58.818633 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:58.818910 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:58.819178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:58.819905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:19:58.820279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:58.821851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a608-a992-48f7-90f9-23dc8c6aa2ea None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:58.836920 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 346/689] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:19:58.843498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:58.947030 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:58.990693 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1519-02d4-4169-8122-729bb6e71528 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:59.040526 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:59.041426 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:59.041706 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:59.041994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/c7b8c451555a48468abd236dad2d1f75/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:59.045366 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=c7b8c451555a48468abd236dad2d1f75, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:59.048007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47501d6-d2ab-4264-a8bc-5f9c5bb3e99c None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:59.067098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 344/690] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:19:58 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/c7b8c451555a48468abd236dad2d1f75/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:20:00.200892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aad83-8488-4e1b-ad57-03a5e914dca5 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.201784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aad83-8488-4e1b-ad57-03a5e914dca5 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.202205 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aad83-8488-4e1b-ad57-03a5e914dca5 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.203992 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 347/691] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:00.210152 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541071b-0903-41f4-852c-0fa4ec6a59b9 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.210985 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541071b-0903-41f4-852c-0fa4ec6a59b9 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.211440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541071b-0903-41f4-852c-0fa4ec6a59b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.235412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-d541071b-0903-41f4-852c-0fa4ec6a59b9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:00.237030 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-d541071b-0903-41f4-852c-0fa4ec6a59b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:00.322616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 345/692] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:00.511806 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccda0c-44ed-4a2d-9c30-df79fde10de2 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.512021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccda0c-44ed-4a2d-9c30-df79fde10de2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.512304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccda0c-44ed-4a2d-9c30-df79fde10de2 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.514038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 348/693] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:00.520798 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1142-abd5-4fc8-b1ba-aad06f3711a6 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.521151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1142-abd5-4fc8-b1ba-aad06f3711a6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.521392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1142-abd5-4fc8-b1ba-aad06f3711a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.542707 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-8c6e1142-abd5-4fc8-b1ba-aad06f3711a6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:00.543992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-8c6e1142-abd5-4fc8-b1ba-aad06f3711a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:00.610581 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:00.623188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 346/694] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:00.668773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccda0c-44ed-4a2d-9c30-df79fde10de2 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:00.714547 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35d71b-5104-44a9-a3b5-62f00c3781e1 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.714940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35d71b-5104-44a9-a3b5-62f00c3781e1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.715224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35d71b-5104-44a9-a3b5-62f00c3781e1 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.718085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 347/695] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:00.722634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.723048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.723285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.750735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:00.752395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:00.807625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccda0c-44ed-4a2d-9c30-df79fde10de2 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:00.844030 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 348/696] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:00.844399 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:00.853052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:00.853691 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:00.853968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:00.854236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] PATH_INFO: `/v3/services/image` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:00.854827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:00.856231 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:00.866484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:00.867689 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:00.868733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 349/697] 10.222.0.75 () {56 vars in 1105 bytes} [Tue Aug 23 23:20:00 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:00.877086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.002513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e1aeb-e433-4050-b777-8201d1e9b916 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.027376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.043347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.044385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.044862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.045323 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.055475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] RBAC: Adding query filter params (name=image) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.055475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.055475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.055475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:01.071512 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 349/698] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.077322 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.215915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946e58-6e64-4dd1-8dab-c4220664a9ee None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.247134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ce20-12c9-4af0-8d96-3435af4c6a92 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.260310 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.260975 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.261256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.261756 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.262279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.263838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:01.274678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:01.275781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.277007 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 350/699] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:01.277799 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.320883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.322075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.322800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.323278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.324724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] RBAC: Adding query filter params (type=image) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.325674 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.328005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.336661 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 350/700] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:20:01.337847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.372041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:01.403342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:01.434456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b06ba-e886-44ba-b60b-5467733c8be0 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.481232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596fd45-5092-4084-823d-418b1a05df9b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.490165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.490823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.491107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.491420 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.492477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.493528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:01.503620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:01.512881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:01.513764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 351/701] 10.222.0.75 () {56 vars in 1129 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:01.514593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.536252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.537199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.537505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.537761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.538741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] RBAC: Adding query filter params (name=network) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.539042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.540854 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.547600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 351/702] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.548495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.677478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a5b2-8631-4f46-8604-ac3e71fbdc5a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.684748 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86754-3bb5-489f-af27-932fc4c06a4c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.694962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:01.703555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:01.721975 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.722763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.723135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.723904 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.724055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.724151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.724151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.724396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.724496 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.724891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.725024 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] RBAC: Adding query filter params (interface=public, service_id=05b9f3144e9a43f19aff94c4ae5b0d6d, region_id=RegionOne) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.725348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.726488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.726723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea017ef-6b95-49df-adb3-5a1d2751550c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.731655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 352/703] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.732518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.737121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 352/704] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/endpoints?service_id=05b9f3144e9a43f19aff94c4ae5b0d6d&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.737668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac06c-7dc9-4e2a-8728-6d5a1ee0a7e0 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.739088 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac06c-7dc9-4e2a-8728-6d5a1ee0a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.739088 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac06c-7dc9-4e2a-8728-6d5a1ee0a7e0 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.739955 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 353/705] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:01.740467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac06c-7dc9-4e2a-8728-6d5a1ee0a7e0 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.861886 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc087ef-7215-4a2e-b6ff-2b91131aaf11 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.865486 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac06c-7dc9-4e2a-8728-6d5a1ee0a7e0 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:01.899479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.900136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.900428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.900701 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.901349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] RBAC: Adding query filter params (type=network) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.901655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.902315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:01.902933 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.903082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.903238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.903479 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.904176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:01.904502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:01.905953 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3a5e0-b53d-4f34-87f4-f36a1b8a7719 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:01.908218 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 353/706] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.909653 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:01.915947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 354/707] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:01.917360 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:01.917649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:01.917923 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:01.938084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:01.939253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:01.992939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.030617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 355/708] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:02.031533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.092363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.152579 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176c28c-f8a1-440a-a8d1-95bb065d504e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.153945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cdde2-7333-471c-9769-90d83039da35 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.209623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.210027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.210294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.210566 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.211171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.212748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.214239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.214984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.215364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.215734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.216578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] RBAC: Adding query filter params (interface=public, service_id=f89fe2222b9648deba05ebb614071789, region_id=RegionOne) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:02.217260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.218497 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.226818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 354/709] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:01 2022] GET /identity/v3/services => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:02.226818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.227278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 356/710] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/endpoints?service_id=f89fe2222b9648deba05ebb614071789&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:02.231720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.392505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493916-f57b-4936-8415-7d3f600b53d7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.402714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.445818 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.472212 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.472212 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.472212 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.472212 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.473274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] RBAC: Adding query filter params (interface=public, service_id=7f3e86af9b5a4a34ad2d90db0afa3315, region_id=RegionOne) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:02.473274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.473274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.483698 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 355/711] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/endpoints?service_id=7f3e86af9b5a4a34ad2d90db0afa3315&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:02.485931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.526170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de74719-8d23-4904-88d2-5fb35e5f0495 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.568116 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.568739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.569011 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.569270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.569879 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.571272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.577668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 357/712] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/services => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:02.578533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.660001 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0c67-fac4-4625-8999-25c18f9b74e6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.706324 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.707420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.707930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.708473 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.727801 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:20:02.731556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e152522-412d-4ede-853f-6a6ceae6512e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:20:02.733544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:02.734484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:20:02.735319 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:02.736101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.738435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 356/713] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:02.749572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:02.790006 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:02.791397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.792121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.793198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.793198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.793377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.795460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.805295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 358/714] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/services => generated 1002 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:02.889428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6ea46-43aa-481c-b36c-431a6219ba4c None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:02.935273 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:02.936011 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:02.936297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:02.936567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:02.937252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:02.937562 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:02.939677 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:02.953398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 357/715] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:02.961365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:03.083671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d041-e860-43f9-b04f-9f5f0f1a710e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:03.124228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:03.124887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:03.125237 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:03.125730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:03.137308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:03.138775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:20:03.154685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:03.155704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:20:03.156627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:20:03.156627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:03.156627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:03.156627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 359/716] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:03.162286 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:03.269458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:03.280307 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48556a9c-0cf4-492b-8acd-605a9e99ca7a None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:03.329050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:03.329734 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:03.330009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:03.330277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:03.330976 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:03.331278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:03.333067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:03.346671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 358/717] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:03.352721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:03.377149 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:03.467503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256551b6-1f03-4f5b-8c15-f2bcfec04860 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:03.505484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:03.506184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:03.506458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:03.506723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:03.515996 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:03.517577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:20:03.531563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:03.532717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:03.533698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 360/718] 10.222.0.75 () {56 vars in 1093 bytes} [Tue Aug 23 23:20:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:03.539499 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:03.654791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4288e-e14c-4c0e-b877-7d0fe581fe8e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:03.691836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:03.692726 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:03.693175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:03.693600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:03.694519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:03.694970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:03.696586 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:03.718155 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 359/719] 10.222.0.75 () {56 vars in 1133 bytes} [Tue Aug 23 23:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:03.724078 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:03.814742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:03.836358 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b147-d142-4027-b92f-88bd9a6aa15a None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:03.875425 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:03.876502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:03.876879 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:03.877243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:03.966955 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:03.968483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:04.054841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:04.078638 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 361/720] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:20:03 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:20:04.085037 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:04.099167 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:04.214364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc344c-4a55-478c-86a2-f641276f7901 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:04.252971 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:04.253631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.254432 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.254716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.266355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:04.267909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:20:04.284362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:04.287394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:20:04.290064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:20:04.290064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:04.290064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:04.290064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 360/721] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:04.293963 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:04.403798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd010308-75fe-4f0f-bf6e-b41ee517f802 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:04.442838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:04.443845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.444348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.444820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.445678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:04.446238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:04.447935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:04.461831 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 362/722] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:04.469351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:04.548639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:04.603774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd23c0-e7af-461c-8e7c-def8806e1c1b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:04.641897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:04.642938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.643421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.643988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.652841 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:04.654725 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-32d86f20-522d-4216-bbe3-a4e7ce9e211e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:20:04.667631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:04.668696 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:20:04.669608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:04.672211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 361/723] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:04.678561 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:04.726726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:04.773271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ddb1f-7353-49bf-9151-12ede6d8de1a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.773749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ddb1f-7353-49bf-9151-12ede6d8de1a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.774210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ddb1f-7353-49bf-9151-12ede6d8de1a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.776996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 362/724] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:04.784791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307c9b-0e90-4e7e-8a74-4f864e1f029b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.785200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307c9b-0e90-4e7e-8a74-4f864e1f029b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.785448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307c9b-0e90-4e7e-8a74-4f864e1f029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.804972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-7a307c9b-0e90-4e7e-8a74-4f864e1f029b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:04.806071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-7a307c9b-0e90-4e7e-8a74-4f864e1f029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:04.813651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c25d2-bd8f-4357-a994-1f5adc936707 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:04.870694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:04.871378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:04.871658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:04.871951 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:04.872673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:04.872980 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:04.874481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:04.900882 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 363/725] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:04.903395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:04.910283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 363/726] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:05.038238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:05.043309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d49ef-957e-4567-a8b0-853b68918284 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.064403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af135f10-fb5f-4b05-9b77-c76d2de105c7 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.064403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af135f10-fb5f-4b05-9b77-c76d2de105c7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.064648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af135f10-fb5f-4b05-9b77-c76d2de105c7 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.066079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 364/727] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:05.073464 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2df3-7514-49fe-b1e4-25583846237e None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.073464 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2df3-7514-49fe-b1e4-25583846237e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.073765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c2df3-7514-49fe-b1e4-25583846237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.102583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:05.103254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.103537 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.103849 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.104257 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-0a8c2df3-7514-49fe-b1e4-25583846237e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:05.104637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=c7b8c451555a48468abd236dad2d1f75) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:05.104947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:05.106231 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-0a8c2df3-7514-49fe-b1e4-25583846237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:05.106435 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:05.115944 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 364/728] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:20:04 2022] GET /identity/v3/role_assignments?user.id=c7b8c451555a48468abd236dad2d1f75&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:05.193012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:05.221734 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 365/729] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:05.285713 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:05.427412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fe49-21a3-44e2-88d1-044f607ffe7a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.427681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fe49-21a3-44e2-88d1-044f607ffe7a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.427979 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fe49-21a3-44e2-88d1-044f607ffe7a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.429613 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 366/730] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:05.437383 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.437671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.437943 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.448163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa06fd7-b920-40da-b000-ee6e8ee1ad72 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.467478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:05.469222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:05.511011 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:05.512591 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.513289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.513985 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] PATH_INFO: `/v3/services/image` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.515326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:05.518494 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:05.536179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:05.538212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:20:05.539961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:05.544307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 365/731] 10.222.0.75 () {56 vars in 1105 bytes} [Tue Aug 23 23:20:05 2022] GET /identity/v3/services/image => generated 86 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:05.557054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:05.578875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 367/732] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:05.580511 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:05.611386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:05.710169 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760481-f468-43bf-9002-1b73e5a41927 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.712879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a948839-ca9c-4c59-a430-b9b0bd9bec68 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.729501 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:05.755184 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:05.755926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.756312 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.756673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] PATH_INFO: `/v3/services/network` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.757640 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:05.759002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:05.759349 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:05.760064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.760584 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.761044 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.762095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] RBAC: Adding query filter params (name=image) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:05.762664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:05.764603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:05.770373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:05.771466 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:20:05.773045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:05.778934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 368/733] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:05 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:05.779513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 366/734] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:05.780395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:05.781451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:05.934110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e37fa-4902-467d-939e-25e4d2f01b31 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.936769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:05.948166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26877891-d2c7-4152-a35c-5f8d08e58706 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:05.990070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:05.990823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:05.991294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:05.991719 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:05.992882 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] RBAC: Adding query filter params (name=network) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:05.993386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:05.994975 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.006148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 369/735] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:06.006148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.008475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.009624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.010268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.010746 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.011608 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] RBAC: Adding query filter params (type=image) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:06.012289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.014284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.021324 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 367/736] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:20:06.022129 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.073394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:06.158932 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559fa95-4c8a-47d7-852b-424a5eac5547 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.167134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1405b47-1fff-4210-a99a-135b8f896ccf None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.208539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.208768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.209160 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.209300 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.209452 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.209544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.209740 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.209846 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.210347 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] RBAC: Adding query filter params (type=network) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:06.210456 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.210668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.212160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.212537 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.223596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 368/737] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:06.223596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:06.223909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:06.226057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:20:06.226891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:06.228506 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 370/738] 10.222.0.75 () {56 vars in 1129 bytes} [Tue Aug 23 23:20:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:06.229233 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.252349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:06.365536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76cb3a-e45d-4312-95fa-6470abfe221b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.365753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83cfb6-e86d-4e7e-8eff-c77192bbe8f6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.369017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:06.405671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.406073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.406588 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.406817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.407631 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.408581 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.409079 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.409265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.409523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.409823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.410835 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.412369 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.437632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 369/739] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:06.438226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.447646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 371/740] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:06.558706 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:06.629299 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2a7e1-b1c5-474c-bd75-df94a2956862 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.713720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.714542 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.714905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.715142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.716038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:06.716345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.718104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.724282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 370/741] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:20:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:06.730807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:06.863422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa782d-1022-4c5d-9cb1-f36bf592cdcd None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:06.927285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:06.927956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:06.928265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:06.928532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:06.929163 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:06.929464 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:06.930848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c7f0-c162-4c89-8e6b-9bca9d9ec8c7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:06.941358 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 372/742] 10.222.0.75 () {56 vars in 1124 bytes} [Tue Aug 23 23:20:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:06.943166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:07.064469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4932b-552f-46fd-aa0c-fa375233e032 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:07.101678 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:07.109175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:07.109823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:07.110094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:07.110363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:07.111132 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:07.112606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27956c4-4274-4c6f-951b-291cb77e37a3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:07.143996 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 371/743] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:07.792245 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07588-24f2-4065-94f1-a8b15e7864c5 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:07.792890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07588-24f2-4065-94f1-a8b15e7864c5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:07.792890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07588-24f2-4065-94f1-a8b15e7864c5 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:07.794729 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 373/744] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:07.800562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:07.801103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:07.801103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:07.823138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:07.824440 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:07.918519 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 372/745] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:07 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:08.283112 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07588-24f2-4065-94f1-a8b15e7864c5 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:08.323921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:08.438163 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07588-24f2-4065-94f1-a8b15e7864c5 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:08.480786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:08.481497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:08.481772 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:08.482034 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:08.482760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:08.484230 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:08.493952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:08.495054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:08.495995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:08.500354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 374/746] 10.222.0.75 () {56 vars in 1132 bytes} [Tue Aug 23 23:20:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:08.501254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:08.623398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e4d04-ecca-4e20-8207-4a4224aa91c9 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:08.639696 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:08.665739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:08.666416 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:08.666704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:08.667035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:08.667673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:08.668047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:08.669439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067c9ce-5c03-41e2-a8a0-0d234c5d87ff None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:08.674587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 373/747] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:08.680493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:08.783760 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:08.805968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf281de-80e0-4774-afd2-542406f2ed3f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:08.871010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:08.872171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:08.872659 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:08.873105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:08.874255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:08.874714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:08.878237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1e05d-5fc1-4be1-9f49-d7afb5368df5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:08.892462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 375/748] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:09.027220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba140-0497-4339-82f7-4d0647414687 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:09.028104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba140-0497-4339-82f7-4d0647414687 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:09.028104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba140-0497-4339-82f7-4d0647414687 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:09.030431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 374/749] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:09.038532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50179795-95a0-4c57-a183-acbe564a4bc0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:09.038987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50179795-95a0-4c57-a183-acbe564a4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:09.039238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50179795-95a0-4c57-a183-acbe564a4bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:09.063435 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-50179795-95a0-4c57-a183-acbe564a4bc0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:09.064748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-50179795-95a0-4c57-a183-acbe564a4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:09.158120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 376/750] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:09 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:09.503229 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba140-0497-4339-82f7-4d0647414687 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:09.660884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba140-0497-4339-82f7-4d0647414687 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:09.707325 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:09.708326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:09.708777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:09.709218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:09.780718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:09.811333 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee61a58-6057-453b-8b23-a63562357313 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:09.812055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee61a58-6057-453b-8b23-a63562357313 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:09.812055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee61a58-6057-453b-8b23-a63562357313 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:09.813405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 377/751] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:09.822327 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:09.822673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:09.822864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:09.824235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:09.826092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:09.846308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:09.848372 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:09.952766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 378/752] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:09 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:09.973938 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 375/753] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:20:09 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:20:09.980861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:09.996407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:10.141017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1605c-6915-4ec1-be75-77a7061ab234 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:10.202161 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576613-4405-461f-be25-e77ce4918857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:10.203182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576613-4405-461f-be25-e77ce4918857 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:10.203637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576613-4405-461f-be25-e77ce4918857 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:10.204136 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576613-4405-461f-be25-e77ce4918857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:10.225517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576613-4405-461f-be25-e77ce4918857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:10.227100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576613-4405-461f-be25-e77ce4918857 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-34576613-4405-461f-be25-e77ce4918857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:20:10.244491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:10.245549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:20:10.246527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:20:10.246527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:20:10.246527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:10.246527 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 379/754] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:10.254878 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:10.352468 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576613-4405-461f-be25-e77ce4918857 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:10.363738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:10.394919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc3bc-fade-4269-9752-1509d647960b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:10.439021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:10.439642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:10.439954 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:10.440231 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:10.440889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:10.441366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:10.442528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:10.442768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:10.457123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 376/755] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:10.515937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576613-4405-461f-be25-e77ce4918857 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:10.563141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:10.563938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:10.564228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:10.564492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:10.565246 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:10.566925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:10.578215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:10.580069 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:10.582164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:10.585236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 380/756] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:20:10.586751 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:10.745815 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faed055-acfe-4788-a12a-5d39cffeae60 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:10.810900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:10.811530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:10.811806 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:10.812163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:10.813075 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:10.813378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:10.814784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69fadb-fdc3-4786-83a7-05fb84084ad8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:10.825959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 377/757] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:10.827804 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:10.948637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8a71-0312-47dd-b00d-1f17829080f7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:10.979702 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:10.988014 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:10.988636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:10.988914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:10.989178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:10.989837 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:10.990139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:10.991531 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3565-8024-4a7e-90d4-77af69631dd5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:10.996663 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 381/758] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:11.289917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae10b-6e9a-498b-96dd-01278566b362 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:11.290453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae10b-6e9a-498b-96dd-01278566b362 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:11.290453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ae10b-6e9a-498b-96dd-01278566b362 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:11.291997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 378/759] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:11.297391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f872-2aa7-48d9-a907-c6a27f085642 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:11.297675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f872-2aa7-48d9-a907-c6a27f085642 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:11.297950 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f872-2aa7-48d9-a907-c6a27f085642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:11.322470 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-b524f872-2aa7-48d9-a907-c6a27f085642 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:11.323688 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-b524f872-2aa7-48d9-a907-c6a27f085642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:11.394105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 382/760] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:11 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:11.718300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ae10b-6e9a-498b-96dd-01278566b362 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:11.721401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:11.826838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ae10b-6e9a-498b-96dd-01278566b362 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:11.862671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:11.863354 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:11.863825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:11.864119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:11.864787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:11.866172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3485a-8d94-4be8-84dd-08621de41326 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:11.884034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 379/761] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:20:11 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:13.214143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b50b-4cc1-44b6-b698-14e9995f65d5 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:13.214720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b50b-4cc1-44b6-b698-14e9995f65d5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:13.214720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8b50b-4cc1-44b6-b698-14e9995f65d5 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:13.216329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 383/762] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:13.221637 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e334-dc01-4f5c-93a4-c70909abbe9a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:13.222209 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e334-dc01-4f5c-93a4-c70909abbe9a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:13.222393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96e334-dc01-4f5c-93a4-c70909abbe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:13.249163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0e96e334-dc01-4f5c-93a4-c70909abbe9a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:13.250470 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0e96e334-dc01-4f5c-93a4-c70909abbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:13.338276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:13.361216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 380/763] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:13 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:20:13.687944 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8b50b-4cc1-44b6-b698-14e9995f65d5 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:13.799773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8b50b-4cc1-44b6-b698-14e9995f65d5 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:13.824201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:13.839716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:13.840357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:13.840637 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:13.840905 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:13.841601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:13.842957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4541874-46cc-4626-99ac-5bc4358a65b7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:13.858633 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 384/764] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:20:13 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:14.183801 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e5fc-2458-4d48-861f-4d629a1ad14f None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:14.184110 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e5fc-2458-4d48-861f-4d629a1ad14f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:14.184387 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e5fc-2458-4d48-861f-4d629a1ad14f None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:14.186040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 381/765] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:14.192947 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:14.193235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:14.193514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:14.217606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:14.218818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:14.312143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 385/766] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:14.645407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e5fc-2458-4d48-861f-4d629a1ad14f None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:14.765341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e5fc-2458-4d48-861f-4d629a1ad14f None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:14.802147 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:14.802777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:14.803047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:14.803311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:14.803927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:14.805306 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:14.814959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:14.816161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:14.817048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 382/767] 10.222.0.75 () {56 vars in 1132 bytes} [Tue Aug 23 23:20:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:14.823116 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:14.933368 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9306-854d-4e0f-ba69-d89f42125c80 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:14.944173 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:14.974422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:14.975054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:14.975364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:14.975657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:14.976353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:14.976757 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:14.978242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:14.983417 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 386/768] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:14.989597 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:15.052721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:15.107446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a1a74-72f3-4db4-a462-fda21356cd20 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:15.143180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:15.143810 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:15.144339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:15.144643 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:15.145353 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:15.145651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:15.147075 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:15.152800 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 383/769] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:15.158978 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:15.267301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1b2a-470a-49ca-85d2-b28e3c136d18 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:15.304923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:15.305542 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:15.305836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:15.306096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:15.306806 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] RBAC: Adding query filter params (interface=public, service_id=5913d4f34f144a4ebe563b65097afd49, region_id=RegionOne) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:15.307116 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:15.308530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec436bf-01a3-4020-bd6e-f6db465eb741 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:15.314149 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 387/770] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:15 2022] GET /identity/v3/endpoints?service_id=5913d4f34f144a4ebe563b65097afd49&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:15.320029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:15.434677 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6b5e-4131-4a57-bd76-7f77a9938c92 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:15.452658 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:15.472976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:15.473775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:15.474241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:15.474716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:15.475380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:15.477043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6e238-e8f1-4c60-a274-9928ce4f041b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:15.484270 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 384/771] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:15 2022] GET /identity/v3/services => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:16.132773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c29e-3694-43e7-bd74-c8b359341e6c None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:16.133058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c29e-3694-43e7-bd74-c8b359341e6c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:16.133331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c29e-3694-43e7-bd74-c8b359341e6c None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:16.134718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 388/772] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:16.140712 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:16.141184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:16.141281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:16.161323 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:16.162930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:16.241516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 385/773] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:16 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:16.568052 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7c29e-3694-43e7-bd74-c8b359341e6c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:16.616666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:16.721788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7c29e-3694-43e7-bd74-c8b359341e6c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:16.771994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:16.772765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:16.773132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:16.773515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:16.774305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:16.775815 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:16.785752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:16.787120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:16.788198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 389/774] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:16.795533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:16.915093 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5d978-72c5-48f8-85fe-e5e78ff03b66 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:16.927354 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:16.962197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:16.962821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:16.963099 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:16.963366 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:16.964040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:16.964332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:16.965719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:16.971380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 386/775] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:16.977413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.109492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:17.112583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d038-12a0-431b-9830-40f9d935047f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.150001 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313abce-3903-4528-8500-d0215757c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.150624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313abce-3903-4528-8500-d0215757c241 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.150906 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313abce-3903-4528-8500-d0215757c241 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.151180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313abce-3903-4528-8500-d0215757c241 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.151847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313abce-3903-4528-8500-d0215757c241 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:17.152188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313abce-3903-4528-8500-d0215757c241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.153610 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313abce-3903-4528-8500-d0215757c241 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.159150 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 390/776] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:17.166266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.295267 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa8993-d938-494e-ac38-5e2ea09305e9 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.335275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.335907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.336192 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.336459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.337434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] RBAC: Adding query filter params (interface=public, service_id=1edbe70f09e0440b903d7b51a5c7df4c, region_id=RegionOne) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:17.337766 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.339151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e89d95-98b8-44b3-aac1-704150104a34 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.346565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 387/777] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:17 2022] GET /identity/v3/endpoints?service_id=1edbe70f09e0440b903d7b51a5c7df4c&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:17.352288 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313abce-3903-4528-8500-d0215757c241 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.507209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313abce-3903-4528-8500-d0215757c241 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.561746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.562351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.562618 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.562883 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.563491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.564902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be9c92-432f-45a4-ad72-d24abb27d152 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.580567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 391/778] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:17 2022] GET /identity/v3/services => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:20:17.819433 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bb35-e9ea-417b-8e77-c430374dde50 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.819655 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bb35-e9ea-417b-8e77-c430374dde50 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.819847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673bb35-e9ea-417b-8e77-c430374dde50 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.821269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 388/779] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:17.827433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.827715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.828027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.847950 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:17.849164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:17.876581 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:17.930634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 392/780] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:18.257827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673bb35-e9ea-417b-8e77-c430374dde50 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.318905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:18.387998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673bb35-e9ea-417b-8e77-c430374dde50 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.430044 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.430672 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.430930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.431199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.431781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.433182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:18.442235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:18.443754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:18.445242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 389/781] 10.222.0.75 () {56 vars in 1132 bytes} [Tue Aug 23 23:20:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:18.449534 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.556548 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6420-d501-47cd-afb6-f38ccfa1cb3d None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.596345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.597152 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.597440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.597733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.598463 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:18.598770 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.600249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.610379 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 393/782] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:18.612502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.725452 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f074a0-bf04-4e04-979b-8d03e88eb983 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.727060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:18.766578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.767193 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.767472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.767787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.768483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:18.768830 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.770412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9630-1fee-4f63-a983-73425b4c902d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.776072 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 390/783] 10.222.0.75 () {56 vars in 1126 bytes} [Tue Aug 23 23:20:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:18.782129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.812182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:18.896270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310bd94-1969-42eb-babf-efeee2c6ff36 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.933174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.933780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.934062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.934335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.934996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.936408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456b50c-4790-47ad-9346-d892a22b161e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.958872 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 394/784] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:19.789718 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955855-2b4a-4a38-831a-503bdc236e31 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.790282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955855-2b4a-4a38-831a-503bdc236e31 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.790282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955855-2b4a-4a38-831a-503bdc236e31 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.791584 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 391/785] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:19.796949 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.797419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.797516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.816423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:19.817533 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:19.894167 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 395/786] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:19 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:20.215905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955855-2b4a-4a38-831a-503bdc236e31 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.332166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955855-2b4a-4a38-831a-503bdc236e31 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.365777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.366393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.366644 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.366932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.367476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.368898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:20.377988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:20.379302 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:20.380220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 392/787] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:20.385403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.388626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:20.492558 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013a38-4f94-48c6-bab4-498a2811273b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.527285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.527924 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.528193 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.528463 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.529177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:20.529832 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.530937 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.535583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 396/788] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:20.541421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.578723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:20.684259 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee5ca-a372-48fe-acc0-9f33d67eafea None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.732166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.732768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.733055 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.733311 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.733988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:20.734277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.735659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb252-45b0-4126-b5ff-c818f05ec80d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.741111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 393/789] 10.222.0.75 () {56 vars in 1114 bytes} [Tue Aug 23 23:20:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:20.747570 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.828348 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:20.865763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213bdbc-8085-4706-a0ab-cc31c3e7f3e2 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.905703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.906318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.906597 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.906961 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.907535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.908952 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d2acc-800e-46ab-811c-11374f826f6f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.939756 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 397/790] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:21.201891 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545a1a-0fb7-465d-8b7f-0015da81ba0e None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:21.202444 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545a1a-0fb7-465d-8b7f-0015da81ba0e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:21.202444 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545a1a-0fb7-465d-8b7f-0015da81ba0e None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:21.203759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 394/791] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:21.209542 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:21.209828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:21.210104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:21.228691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:21.229902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:21.310687 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 398/792] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:21.634664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545a1a-0fb7-465d-8b7f-0015da81ba0e None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:21.741558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:21.750264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545a1a-0fb7-465d-8b7f-0015da81ba0e None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:21.787062 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:21.787676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:21.787983 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:21.788247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:21.788817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:21.790191 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:21.798909 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:21.800721 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:21.802315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 395/793] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:21.806470 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:21.860481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:21.912808 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb667-7fd9-4c0c-bbca-27c778b52e6e None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:21.946948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:21.947547 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:21.947836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:21.948140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:21.948768 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:21.949061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:21.950775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91924-5b38-4260-91d0-a9b208cf24fc None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:21.955464 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 399/794] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:21.961428 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:22.066946 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8803d5-d0f1-417d-b409-9949630b0b90 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:22.105820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:22.106413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:22.106685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:22.106948 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:22.107587 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:22.107896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:22.109282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b604-f394-478e-be2e-773d95b9e434 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:22.114642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 396/795] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:20:23.188004 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2334d-299b-491d-a19c-71b10f8a70d2 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:23.188648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2334d-299b-491d-a19c-71b10f8a70d2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:23.188648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2334d-299b-491d-a19c-71b10f8a70d2 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:23.190034 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 400/796] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:23.195998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:23.196497 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:23.196497 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:23.218018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:23.219259 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:23.239959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:23.309443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 397/797] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:23 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:23.642391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2334d-299b-491d-a19c-71b10f8a70d2 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:23.754574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2334d-299b-491d-a19c-71b10f8a70d2 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:23.770484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:23.799304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:23.799988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:23.800269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:23.800636 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:23.801301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:23.802759 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:23.805475 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING keystone.server.flask.common [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:20:23.826913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.sql.core [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:20:23.826913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:20:23.826913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [parameters: {'id': '514ddc92516149e88b58cf25286b821f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:20:23.826913 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514ddc92516149e88b58cf25286b821f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514ddc92516149e88b58cf25286b821f. Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:20:23.844766 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result.read() Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 23:20:23.846330 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application yield resource Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise self.value Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application session.commit() Aug 23 23:20:23.847902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:20:23.848901 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:20:23.850683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result.read() Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:20:23.851851 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [parameters: {'id': '514ddc92516149e88b58cf25286b821f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:23.853279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:23.854528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 514ddc92516149e88b58cf25286b821f. Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:23.856082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 401/798] 10.222.0.75 () {60 vars in 1140 bytes} [Tue Aug 23 23:20:23 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:23.856700 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:23.960060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2873-2a94-47cc-b80c-49af1f2d8668 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:23.996628 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:23.997269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:23.997526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:23.997829 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.004819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:24.006278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-0da1da4d-b289-4d7e-af50-f90dbde10d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:20:24.017752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:24.018976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:24.020344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 398/799] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:24.025297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:24.139171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a49f7-370e-49a0-9095-20221d5796e4 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:24.184994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:24.185630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.185906 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.186168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.186820 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:24.187116 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:24.188818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46300b19-aef6-4655-9d5e-ab9fdff17171 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:24.212282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 402/800] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:24.334087 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34461-c8dc-4fa8-b5c4-022e69c38dad None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.334650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34461-c8dc-4fa8-b5c4-022e69c38dad None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.334650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e34461-c8dc-4fa8-b5c4-022e69c38dad None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.335974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 399/801] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:24.342077 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcde3-e267-4a63-9d5f-c8ebf7217dc0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.342363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcde3-e267-4a63-9d5f-c8ebf7217dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.342740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcde3-e267-4a63-9d5f-c8ebf7217dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.363413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f5fdcde3-e267-4a63-9d5f-c8ebf7217dc0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:24.365094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f5fdcde3-e267-4a63-9d5f-c8ebf7217dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:24.397202 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:24.449255 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 403/802] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:24.777478 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34461-c8dc-4fa8-b5c4-022e69c38dad None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:24.794546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:24.895742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e34461-c8dc-4fa8-b5c4-022e69c38dad None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:24.934465 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:24.935073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.935348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.935616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.936295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:24.937675 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058c4cd-25b3-40f3-aa5c-65bc573adbbb None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:24.955939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 400/803] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:20:24 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:26.480990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8359-b061-4395-92f1-30ec12ca14ea None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.481565 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8359-b061-4395-92f1-30ec12ca14ea None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.481565 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b8359-b061-4395-92f1-30ec12ca14ea None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.482890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 404/804] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:26.489447 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.489939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.489939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.511897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:26.513716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:26.584104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:26.596033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 401/805] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:26 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:26.925130 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b8359-b061-4395-92f1-30ec12ca14ea None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:27.033007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b8359-b061-4395-92f1-30ec12ca14ea None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:27.068770 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:27.069409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.069683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.069948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.070612 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:27.072082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:27.088187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.sql.core [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:20:27.088187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:20:27.088187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [parameters: {'user_id': '00a0404d9bc847c09b3ff380af78d1c6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:20:27.088187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-b7a526f1-4f7f-4777-bbfd-55ce640dbb99 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result.read() Aug 23 23:20:27.095363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:20:27.096455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application yield resource Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise self.value Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application session.commit() Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:20:27.098497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:20:27.099568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:20:27.100692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application result.read() Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:20:27.102219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [parameters: {'user_id': '00a0404d9bc847c09b3ff380af78d1c6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:27.103279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 23:20:27.104334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.105793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 405/806] 10.222.0.75 () {60 vars in 1131 bytes} [Tue Aug 23 23:20:26 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:27.107603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:27.227539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6913e28-5b84-4945-8465-0975e38efbff None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:27.263070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:27.263709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.264016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.264282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.264592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387116-740d-4ae5-85f4-5f659884aa0a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.264873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387116-740d-4ae5-85f4-5f659884aa0a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.265138 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387116-740d-4ae5-85f4-5f659884aa0a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.270283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 406/807] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:27.273022 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:27.274625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:27.276422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.276796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.277068 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:20:27.291329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:27.292778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:27.294376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 402/808] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:20:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:27.300863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:27.302282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:27.304009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:27.323670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:27.368442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:27.386329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 407/809] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:27 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:27.418312 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ff7c-e80c-4427-b35a-10c923d61836 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:27.453975 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:27.454618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.454894 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.455163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.456095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:27.456620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:27.458760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:27.493968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 403/810] 10.222.0.75 () {56 vars in 1101 bytes} [Tue Aug 23 23:20:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:27.715106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:27.818175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d541b-32e0-458f-8aa0-873b3f9b3d05 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:27.857727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:27.858364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:27.858645 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:27.858989 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:27.859571 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:27.861095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:27.870283 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:27.872175 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:20:27.873185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 408/811] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:27.877858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:27.983458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40610-c224-4a73-a603-e86354d462b6 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:28.001754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:28.022182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:28.022787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:28.023060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:28.023327 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:28.023958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:28.024260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:28.025627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:28.030805 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 404/812] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:28.037013 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:28.056412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:28.139827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12881b43-eb0c-4bab-9248-256c8b124099 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:28.178411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:28.179005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:28.179275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:28.179539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:28.180166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:28.180471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:28.181864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:28.186954 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 409/813] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:28.193823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:28.306669 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd8f0-5b71-47ec-b2d2-ae9030845476 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:28.347726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:28.348378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:28.348648 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:28.348919 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:28.349616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] RBAC: Adding query filter params (interface=public, service_id=b4ae4b9dddbf48d985a428c0848a4081, region_id=RegionOne) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:28.349918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:28.351282 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114db64-b2e0-42ca-aed9-33dea4712379 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:28.356777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 405/814] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:20:28 2022] GET /identity/v3/endpoints?service_id=b4ae4b9dddbf48d985a428c0848a4081&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:28.363309 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:28.446143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:28.468273 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c457d1-2806-42f9-a598-74c03326ebc1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:28.503755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:28.504391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:28.504670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:28.504936 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:28.505525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:28.506894 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d20f8f-8a9a-4fe7-ad06-6907aed4d367 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:28.513251 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 410/815] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:20:28 2022] GET /identity/v3/services => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:30.726144 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e04e00-f0de-4b3b-840f-c4abf436b9d6 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:30.726736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e04e00-f0de-4b3b-840f-c4abf436b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:30.726736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e04e00-f0de-4b3b-840f-c4abf436b9d6 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:30.728052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 406/816] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:30.733428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:30.733884 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:30.733988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:30.752652 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:30.753860 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:30.824994 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 411/817] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:20:30 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:20:31.163047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e04e00-f0de-4b3b-840f-c4abf436b9d6 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:31.215737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:31.272134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e04e00-f0de-4b3b-840f-c4abf436b9d6 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:31.309496 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:31.310114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:31.310395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:31.310666 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:31.311245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:31.312646 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:20:31.322086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:20:31.323258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:20:31.324733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:20:31.328066 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 407/818] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:20:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:20:31.329659 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:31.414928 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:31.446117 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060c01-6cfb-4d50-b8ee-0b76d41a78d4 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:31.483845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:31.484539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:31.484821 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:31.485092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:31.485796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:31.486103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:31.488071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:31.493642 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 412/819] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:31.501449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:31.610538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829679-453d-4c09-b00f-4cff5c2e838f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:31.621370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:31.650255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:31.650865 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:31.651138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:31.651414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:31.652077 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:31.652391 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:31.653788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0147-42a4-40a5-bd14-7a05ed31c3a3 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:31.659924 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 408/820] 10.222.0.75 () {56 vars in 1112 bytes} [Tue Aug 23 23:20:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:31.667488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:31.795769 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672cb6-a943-4d82-98cd-be5b50ea9fd0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:31.838351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:31.839017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:31.839301 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:31.839573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:31.840364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:31.841802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb50fa-7c05-4c6c-baff-2fa6f73ef33b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:31.851313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:31.864342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 413/821] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:41.657737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=14 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:41.859698 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:INSERT=1,keystone:SELECT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:37.255536 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e5c3-fad0-4b14-a2b6-f7682930abb7 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:37.256205 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e5c3-fad0-4b14-a2b6-f7682930abb7 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:37.256205 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e5c3-fad0-4b14-a2b6-f7682930abb7 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:37.257586 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 409/822] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:21:37.263578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:37.264121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:37.264201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:37.285664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:37.286962 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:37.386221 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 414/823] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:21:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:21:37.790466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331e5c3-fad0-4b14-a2b6-f7682930abb7 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:37.941078 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331e5c3-fad0-4b14-a2b6-f7682930abb7 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:37.992494 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:37.993560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:37.993946 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:37.994171 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:38.010241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:38.012139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:38.031250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:38.032673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:38.033820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:38.033820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:38.033820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:38.033820 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 410/824] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:38.039373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:38.188028 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de641-ac0e-4772-924f-05d97b35ca65 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:38.227627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:38.240739 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:38.241426 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:38.241705 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:38.242026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:38.243033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:38.243367 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:38.244943 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297dd8-922d-4c8c-8505-3fd9c164393d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:38.262850 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 415/825] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:38.270466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:38.355414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:38.431489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5277-f07a-4924-9dd4-c4be073147e7 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:38.494649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:38.495188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:38.495464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:38.495794 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:38.496475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:38.497942 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620aa75-df49-4c61-b8b2-8d006feb9375 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:38.534593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 411/826] 10.222.0.75 () {60 vars in 1132 bytes} [Tue Aug 23 23:21:38 2022] POST /identity/v3/users => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:21:40.985858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb50a48-22e4-4364-a474-40beae9cb700 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:40.986441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb50a48-22e4-4364-a474-40beae9cb700 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:40.986552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb50a48-22e4-4364-a474-40beae9cb700 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:40.988259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 416/827] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:21:40.996161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:40.997094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:40.997605 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:41.018577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:41.020008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:41.114288 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 412/828] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:21:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:21:41.477207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb50a48-22e4-4364-a474-40beae9cb700 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:41.625324 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb50a48-22e4-4364-a474-40beae9cb700 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:41.665334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:41.666789 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:41.667343 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:41.667976 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:41.682492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:21:41.687859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:41.689100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:41.690058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 417/829] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:41.697266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:41.746074 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:41.818781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce765dd-fb3e-4dc1-beaa-4473970cb850 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:41.872018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:41.874245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:41.874245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:41.874245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:41.875580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:41.876052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:41.878874 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:41.889563 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 413/830] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:41.896997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:41.959690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:42.024225 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3460-64ba-4bdd-a9a8-2fd264ae50a0 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:42.064545 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:42.065343 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:42.065627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:42.065897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:42.078000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:42.079488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:42.096713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:42.098783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:42.100325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:42.100325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:42.100325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:42.100325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 418/831] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:42.104321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:42.255772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:42.260278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4585-ada9-4f9a-8db3-0d5e498a541d None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:42.316200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:42.316828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:42.317106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:42.317372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:42.318038 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:42.318351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:42.319899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:42.336760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 414/832] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:42.344228 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:42.471960 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:42.476592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f4e9-083e-4b0d-a88f-e2bec6135a43 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:42.522100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230e5a-6905-4938-b583-74911727f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:42.522721 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230e5a-6905-4938-b583-74911727f450 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:42.523020 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230e5a-6905-4938-b583-74911727f450 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:42.523285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61230e5a-6905-4938-b583-74911727f450 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:42.535099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230e5a-6905-4938-b583-74911727f450 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:42.536745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61230e5a-6905-4938-b583-74911727f450 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-61230e5a-6905-4938-b583-74911727f450 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:21:42.552623 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:42.554510 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:42.556452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 419/833] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:42.562279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:42.693054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d121c-4430-457a-8993-ebbc08473302 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:42.747277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:42.748012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:42.748296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:42.748593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:42.749415 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:42.749876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:42.751714 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:42.775336 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 415/834] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:21:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:42.783113 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230e5a-6905-4938-b583-74911727f450 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:42.917264 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61230e5a-6905-4938-b583-74911727f450 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:42.963217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:42.964141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:42.964306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:42.964451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:42.998749 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:43.053754 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:43.055181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:43.177153 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 420/835] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:21:42 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:21:43.191898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:43.216580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:43.329330 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498df2e-2d83-4895-87e9-8cc90974f9c5 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:43.374111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95838ac3-ce05-4203-9394-6155848250af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:43.374886 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838ac3-ce05-4203-9394-6155848250af None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:43.375155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838ac3-ce05-4203-9394-6155848250af None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:43.375424 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838ac3-ce05-4203-9394-6155848250af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:43.387512 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95838ac3-ce05-4203-9394-6155848250af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:43.389036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95838ac3-ce05-4203-9394-6155848250af None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-95838ac3-ce05-4203-9394-6155848250af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:43.407372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:43.408617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:43.409889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:43.409889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:43.409889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:43.409889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 416/836] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:21:43.416360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:43.491331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:43.547261 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c47793-df42-4ae6-94ae-29912c7e1008 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:43.599536 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:43.600236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:43.600514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:43.600897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:43.601449 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:43.601745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:43.603125 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:43.621160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 421/837] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:43.628590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95838ac3-ce05-4203-9394-6155848250af None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:43.722103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:43.764930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95838ac3-ce05-4203-9394-6155848250af None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:43.812034 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:43.812979 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:43.813388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:43.813717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:43.823541 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:43.825604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:21:43.840143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:43.841618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:43.843426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 417/838] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:43.851610 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:44.001186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ead13-26a6-42e4-9ed2-164d26cab59d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:44.025017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:44.045156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:44.046404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:44.046848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:44.047249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:44.048245 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:44.048673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:44.050864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7385280-2d0f-4e1b-b568-2a816c2a56ed None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:44.070889 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 422/839] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:44.079479 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:44.216341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca614-d97d-4838-b5a2-734b6276471b None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:44.256682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:44.262266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:44.262982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:44.263462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:44.263900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:44.265398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=3453fc063e964847aa4aad6c2d4242c2) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:44.265753 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:44.267818 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982c2a3-9014-4306-afa1-a4b18e7692e2 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:44.274467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 418/840] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:21:44 2022] GET /identity/v3/role_assignments?user.id=3453fc063e964847aa4aad6c2d4242c2&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:46.722421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b308b-04c7-49a4-99c2-2d6b89418e3b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:46.723034 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b308b-04c7-49a4-99c2-2d6b89418e3b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:46.723215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b308b-04c7-49a4-99c2-2d6b89418e3b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:46.725169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 423/841] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:21:46.732871 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:46.734019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:46.734019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:46.757287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:46.760932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:46.865247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 419/842] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:21:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:21:47.217282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b308b-04c7-49a4-99c2-2d6b89418e3b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:47.410409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b308b-04c7-49a4-99c2-2d6b89418e3b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:47.479297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:47.480119 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:47.480606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:47.481046 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:47.499590 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:21:47.505290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:47.507143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:47.508076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 424/843] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:21:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:47.514326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:47.656458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1b7d4-4e1b-4e49-ae9b-1133fb46b59d None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:47.691854 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:47.705959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:47.706585 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:47.706865 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:47.707152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:47.707808 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:47.709025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:47.709635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:47.719521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 420/844] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:21:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:47.726094 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:47.795134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:47.879629 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c62d-3ecd-408a-8126-87d76dc60a73 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:47.920443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:47.921173 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:47.921517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:47.921862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:47.934104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:47.935644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:47.953411 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:47.954481 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:47.955516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:47.955516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:47.955516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:47.955516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 425/845] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:21:47.961473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:48.117201 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4b2b-65d0-4a8c-ae5f-3b5ca2bf6c95 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:48.163860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:48.164951 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:48.165498 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:48.165987 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:48.166733 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:48.167068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:48.169019 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:48.187502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 421/846] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:48.195051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:48.330676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:48.344550 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef31b-f8a2-47a8-856f-7823fa537c34 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:48.395217 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:48.396090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:48.396451 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:48.396822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:48.409076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:48.410579 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:21:48.423412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:48.424523 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:48.425716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:48.431777 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 426/847] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:48.432944 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:48.495964 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:48.570477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b19c58-995e-4839-9ccf-516ff8000a79 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:48.619829 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:48.620459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:48.620761 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:48.621064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:48.621903 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:48.622171 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:48.624152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:48.647296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 422/848] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:21:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:48.653900 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:48.822434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4dfe-8ba6-4d55-b891-e5cc0e10a96b None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:48.877222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:48.877874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:48.878158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:48.878429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:48.891024 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:48.892599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:48.916836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:48.924742 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:48.926421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:48.926421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:48.926421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:48.926421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 427/849] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:48.928667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:49.071238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4c0c8-7975-4c78-a068-c979fc979331 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:49.074539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:49.116348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:49.117016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:49.117286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:49.117555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:49.118221 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:49.118514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:49.119942 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:49.143239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 423/850] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:49.144560 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:49.148462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:49.300858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5046b-667e-44c4-94ea-d6a04898432e None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:49.345750 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:49.346421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:49.346676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:49.346964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:49.355800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:49.357981 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:21:49.371294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:49.372555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:49.373712 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:49.378568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 428/851] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:21:49.379347 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:49.500615 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b432-cfe2-4a5e-a48a-40f66982a757 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:49.550197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:49.550840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:49.551127 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:49.551493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:49.552487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:49.552854 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:49.554676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed39fd-56c5-4a90-8dca-7e92976ba306 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:49.570734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 424/852] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:49.577873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:49.655079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:49.705958 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7148d06-7320-4655-839a-9706d65ea2d3 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:49.747208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:49.748406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:49.748660 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:49.749082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/3453fc063e964847aa4aad6c2d4242c2/roles/d7d39f62fb0b46a3ab210be426db5d7a` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:49.768700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=3453fc063e964847aa4aad6c2d4242c2, role_id=d7d39f62fb0b46a3ab210be426db5d7a)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:49.770178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d881-67ea-4979-8a5c-149de469cad8 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:49.784281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 429/853] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:21:49 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/3453fc063e964847aa4aad6c2d4242c2/roles/d7d39f62fb0b46a3ab210be426db5d7a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:21:52.115157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341949-4e38-4a66-a7d6-c798f0d8e78e None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:52.115745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341949-4e38-4a66-a7d6-c798f0d8e78e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:52.115745 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28341949-4e38-4a66-a7d6-c798f0d8e78e None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:52.117294 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 425/854] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:21:52.123352 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:52.123902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:52.124120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:52.144105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:52.145425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:52.227761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 430/855] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:21:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:21:52.579901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28341949-4e38-4a66-a7d6-c798f0d8e78e None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:52.610800 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:52.716533 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28341949-4e38-4a66-a7d6-c798f0d8e78e None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:52.779845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:52.780532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:52.780800 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:52.781061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:52.794150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:21:52.800419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:52.802390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:21:52.804313 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:52.807921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 426/856] 10.222.0.75 () {56 vars in 1102 bytes} [Tue Aug 23 23:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:52.809155 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:52.860893 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:52.925103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dacf06-b31a-4146-abb6-0db8fb21756a None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:52.978433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:52.979116 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:52.979429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:52.979744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:52.980492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] RBAC: Adding query filter params (name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:52.980795 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:52.982335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:52.993788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 431/857] 10.222.0.75 () {56 vars in 1103 bytes} [Tue Aug 23 23:21:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:53.000840 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:53.109407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:53.131692 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab8a8-fdc6-4123-8e32-c2462025c4bc None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:53.175737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:53.176429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:53.176729 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:53.177024 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:53.188894 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:53.190376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:53.207736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:53.208898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:53.215723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:53.215723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:53.215723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:53.215723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 427/858] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:53.216063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:53.343680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bfd1-a013-44bb-b68c-e74b8942aa54 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:53.346538 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:53.385975 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:53.386529 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:53.386805 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:53.387075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:53.387745 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:53.388079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:53.390321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:53.402354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 432/859] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:53.408394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:53.546256 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a274e-447e-424b-8ebd-d16865bb6ecb None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:53.586555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:53.587217 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:53.587508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:53.587937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:53.594284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:53.601737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:53.603697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:21:53.617610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:53.619484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:53.620857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 428/860] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:53.626262 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:53.756444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22a8e-dd11-4041-a186-85b8816d3401 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:53.806357 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:53.807007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:53.807269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:53.807532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:53.808304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:53.808631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:53.810107 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:53.844963 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 433/861] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:21:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:53.847502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:53.987384 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce637c-9444-4f79-b916-0c4825226f20 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:54.030941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:54.031538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:54.031898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:54.032182 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:54.106792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:54.115453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:54.117025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:54.252509 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 429/862] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:21:53 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:21:54.259968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:54.297413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:54.391663 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5152-6022-4a1d-9be8-026c71143ac6 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:54.442422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:54.443103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:54.443807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:54.444108 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:54.459092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:54.462050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:54.483755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:54.485773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:54.487605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:54.487605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:54.487605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:54.490651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 434/863] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:54.491863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:54.611810 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:54.620271 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d7bdb-86c0-425b-8423-85e5c03c1df8 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:54.669133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:54.669916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:54.670244 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:54.670688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:54.671414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:54.671774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:54.673398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:54.687240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 430/864] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:54.693976 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:54.799201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:54.828611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7e23-178d-4181-b922-52db07ededeb None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:54.869763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:54.870342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:54.870619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:54.870891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:54.878329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:54.879798 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:21:54.900374 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:54.902394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:21:54.903692 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 435/865] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:21:54.908743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:55.044406 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e2d7-3285-47c1-b7f5-40698fd742ca None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:55.100760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:55.101837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:55.102364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:55.102854 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:55.104006 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:55.104725 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:55.106779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65bc19-eed8-4494-86bc-fa049ceaf1f8 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:55.122283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 431/866] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:55.129366 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:55.247795 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ec2a-31c0-4705-b7cb-0512f72bfbaa None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:55.287968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:55.288600 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:55.288876 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:55.289150 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:55.289945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] RBAC: Adding query filter params (role.id=d7d39f62fb0b46a3ab210be426db5d7a, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=3453fc063e964847aa4aad6c2d4242c2) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:55.290260 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:55.293288 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307ab4-6f6c-4384-a615-bd75c01e44cb None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:55.296185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:55.302114 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 436/867] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:21:55 2022] GET /identity/v3/role_assignments?user.id=3453fc063e964847aa4aad6c2d4242c2&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=d7d39f62fb0b46a3ab210be426db5d7a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:57.769787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67358c-1e4f-47cb-b2ff-13b86fb4c4b3 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:57.770611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67358c-1e4f-47cb-b2ff-13b86fb4c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:57.770732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67358c-1e4f-47cb-b2ff-13b86fb4c4b3 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:57.772259 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 432/868] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:21:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:21:57.781604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:57.782256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:57.782256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:57.804229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:57.805501 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:57.921519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 437/869] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:21:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:21:58.266106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67358c-1e4f-47cb-b2ff-13b86fb4c4b3 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:58.289654 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:58.421221 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67358c-1e4f-47cb-b2ff-13b86fb4c4b3 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:58.468053 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:58.468768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:58.469142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:58.469505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:58.483183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:21:58.489539 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:58.490606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:58.491760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 433/870] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:21:58.498389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:58.636678 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d3d6-bbd6-4357-bb74-0acb375b07a5 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:58.667617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:58.679688 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:58.680548 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:58.680954 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:58.681289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:58.682054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:58.682264 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:58.683704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:58.693477 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 438/871] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:21:58.701582 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:58.810152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:58.835923 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8013-c0e4-498a-8b80-dbc50359ff3f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:58.874694 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:58.875364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:58.875624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:58.875973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:58.890999 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:58.893521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:21:58.914085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:58.915484 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:21:58.922285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:21:58.922285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:21:58.922285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:58.922285 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 434/872] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:58.923848 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:59.049235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dd202-3b57-4d00-be2e-72bf35ba82c4 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:59.091465 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:59.092141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:59.092416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:59.092691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:59.093402 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:59.093680 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:59.095235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:59.112373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 439/873] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:59.119476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:59.241412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0003590-09f4-4c9c-a201-1db471f82999 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:59.274258 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:59.286895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:59.287861 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:59.288361 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:59.288914 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:59.300846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:59.302837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:21:59.318164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:21:59.320236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:21:59.322105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 435/874] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:21:59.327065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:59.398199 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:59.476572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb9c0-8893-4798-8d7d-ff01a8d22156 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:59.528298 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:59.529128 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:59.529601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:59.530071 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:59.531292 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:21:59.531818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:59.534420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:59.570157 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 440/875] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:21:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:21:59.571857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:59.702012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0879c7-e538-4de2-81c9-7bd559b61af6 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:59.747831 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:59.749020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:59.749628 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:59.750266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:59.820212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:59.833505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:59.834995 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:59.949915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 436/876] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:21:59 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:21:59.958007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:00.094335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81bed-ffaa-4143-b9ed-d9380f5a1220 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:00.105842 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:00.137626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:00.139137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:00.139346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:00.139786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:00.154648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:00.156082 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:22:00.176275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:00.177869 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:22:00.179311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:22:00.179311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:00.179311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:00.179311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 441/877] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:22:00.185030 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:00.319073 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:00.335386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969e54-a882-4b9d-93c5-f9365385a533 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:00.382748 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:00.383700 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:00.384364 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:00.384770 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:00.385916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:00.386451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:00.388451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:00.401322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 437/878] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:00.409173 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:00.537709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902b359-a181-4c22-a4d3-4d55103ed439 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:00.582709 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:00.583616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:00.584075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:00.584537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:00.595065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:00.597036 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:22:00.610521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:00.612517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:00.614314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 442/879] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:00.618588 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:00.770326 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d25b-a4a4-4917-8963-2ae7fecb9c71 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:00.813939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:00.814636 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:00.814977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:00.815332 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:00.816278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:00.816866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:00.819025 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad971e-36e3-4132-9f25-64d3c77e137d None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:00.840714 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 438/880] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:00.848102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:00.884325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:00.997875 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cecd-2cdd-4577-a424-86fb4e779ca1 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:01.057847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:01.058445 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:01.058816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:01.059072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:01.060134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=3453fc063e964847aa4aad6c2d4242c2) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:01.060275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:01.061817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05402816-1ff6-40b0-91b8-41c043b89247 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:01.068764 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 443/881] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:22:00 2022] GET /identity/v3/role_assignments?user.id=3453fc063e964847aa4aad6c2d4242c2&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:03.370641 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee5f-fd4c-41c6-b815-9d29281887e3 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:03.371266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee5f-fd4c-41c6-b815-9d29281887e3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:03.371266 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee5f-fd4c-41c6-b815-9d29281887e3 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:03.372754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 439/882] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:03.381289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:03.381793 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:03.388561 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:03.401178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:03.402380 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:03.492129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 444/883] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:22:03.830097 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ee5f-fd4c-41c6-b815-9d29281887e3 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:03.844203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:03.952889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ee5f-fd4c-41c6-b815-9d29281887e3 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:03.990453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:03.991084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:03.991363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:03.991632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.002982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:22:04.007778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:04.009033 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:04.010137 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 440/884] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:04.017896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:04.042248 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.135893 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461b327-b683-4b7a-b9e3-8fa0127ccdae None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:04.174784 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:04.175399 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.175686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.175985 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.176671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:04.176972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:04.178354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:04.188049 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 445/885] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:04.195384 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:04.269675 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.307978 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b50f-e4dc-4910-9af6-2f2063ecaf09 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:04.344931 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:04.345554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.345855 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.346105 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.357112 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:04.358692 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:22:04.373922 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:04.375414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:22:04.376635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:22:04.376635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:04.376635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:04.376635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 441/886] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:22:04.381078 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:04.472539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.498100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4fd16-ebcc-4cab-874d-b6e576a6f354 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:04.536057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:04.536671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.536965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.537236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.537885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:04.538190 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:04.539631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:04.553191 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 446/887] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:04.559558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:04.665094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe726-4cee-456b-b613-3d89adf5282f None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:04.690685 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.706278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:04.706917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.707200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.707457 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.716134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:04.718223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:22:04.734565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:04.736735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:04.738390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 442/888] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:04.744982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:04.902442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5bad-4a21-4662-b2d0-f7d151f4d6f7 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:04.938428 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:04.939025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.939296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.939560 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.940317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:04.940617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:04.942048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:04.944609 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.961296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 447/889] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:04.967245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:05.075569 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23704f-afde-4908-9c52-fa4d03f65232 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:05.110414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:05.111040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:05.111318 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:05.111592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:05.122374 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:05.123836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:22:05.138333 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:05.139458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:22:05.140574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:22:05.140574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:05.140574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:05.140574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 443/890] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:22:05.145934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:05.258396 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9c105-05f9-4568-b0f1-89a02d32f2ad None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:05.301258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:05.301862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:05.302147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:05.302404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:05.303063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:05.303365 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:05.304823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:05.316715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 448/891] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:05.323136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:05.359632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:05.438991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434598-8311-4847-9525-029a2c1c52ac None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:05.474178 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:05.475143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:05.475421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:05.475686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:05.482378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:05.483817 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:22:05.494796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:05.495845 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:05.496784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 444/892] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:05.502779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:05.560733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:05.608960 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cab4-8927-464c-a9c1-6bbebef3dc0d None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:05.644597 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:05.645113 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:05.645386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:05.645650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:05.646353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:05.646657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:05.648141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98729641-18ff-4558-b19d-d1e3efbfac67 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:05.660281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 449/893] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:05.666491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:05.774856 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:05.787656 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d930d-1f0a-4587-b2f0-ebda547b6791 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:05.826961 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:05.827618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:05.827902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:05.828184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] PATH_INFO: `/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/3453fc063e964847aa4aad6c2d4242c2/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:05.830090 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ab3e0badff4106b560d809f6157c2f, user_id=3453fc063e964847aa4aad6c2d4242c2, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:05.831538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b73de0-ac00-48d6-b3e0-a86368b1098a None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:05.847184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 445/894] 10.222.0.75 () {58 vars in 1439 bytes} [Tue Aug 23 23:22:05 2022] PUT /identity/v3/projects/c8ab3e0badff4106b560d809f6157c2f/users/3453fc063e964847aa4aad6c2d4242c2/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:22:08.057754 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab253e-3c76-4ba0-b780-6782dea4da91 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:08.058347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab253e-3c76-4ba0-b780-6782dea4da91 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:08.058347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab253e-3c76-4ba0-b780-6782dea4da91 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:08.059649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 450/895] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:08.065360 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:08.065825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:08.065825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:08.084679 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:08.085932 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:08.155517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 446/896] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:22:08.503831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab253e-3c76-4ba0-b780-6782dea4da91 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:08.613616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab253e-3c76-4ba0-b780-6782dea4da91 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:08.630281 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:08.652302 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:08.652932 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:08.653209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:08.653546 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:08.664397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:22:08.669572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:08.676817 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:08.677935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 451/897] 10.222.0.75 () {56 vars in 1096 bytes} [Tue Aug 23 23:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:08.678829 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:08.768796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:08.807392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b3f5-246a-483a-8a6b-b80ffb8e56c0 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:08.855419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:08.856058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:08.856338 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:08.857149 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:08.857385 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:08.857687 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:08.859085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:08.868846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 447/898] 10.222.0.75 () {56 vars in 1099 bytes} [Tue Aug 23 23:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:08.875858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:08.986982 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e876-65e1-4579-aba9-902963b0b743 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:09.028025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:09.028625 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:09.028896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:09.029160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:09.040316 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:09.041763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:22:09.056811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:09.058923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:22:09.060100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:22:09.060100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:09.060100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:09.060100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 452/899] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:09.065998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:09.187166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfcfbd-ba13-4009-b57d-2e4794b833fc None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:09.226067 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:09.226665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:09.226957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:09.227222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:09.227898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:09.228208 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:09.229610 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:09.241939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 448/900] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:09.248352 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:09.277170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:09.363024 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac4f4-f725-4244-82ac-bf35c2ea91f3 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:09.402418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:09.403058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:09.403479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:09.403956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:09.412293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:09.413900 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:22:09.426176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:09.428045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:09.430168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 453/901] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:22:09.434806 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:09.438866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:09.544095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321658f-1a17-487d-9ec7-9a7ce9680c2c None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:09.581535 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:09.582220 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:09.582440 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:09.582719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:09.583474 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:09.583786 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:09.585297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:09.607479 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 449/902] 10.222.0.75 () {56 vars in 1143 bytes} [Tue Aug 23 23:22:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:09.614644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:09.705844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:09.723317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af90d7c-3b26-4b44-9a50-c27ee8b8ae74 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:09.760147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:09.760895 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:09.761057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:09.761299 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:09.843471 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:09.844864 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:09.942541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:09.960985 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 454/903] 10.222.0.75 () {58 vars in 1282 bytes} [Tue Aug 23 23:22:09 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:22:09.967211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.044604 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:10.085767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f6555-13c9-4944-b322-e3bbb5a850ff None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:10.122370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:10.123136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.123559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.123933 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.134988 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:10.136506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:22:10.152663 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:10.154704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:22:10.155997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:22:10.155997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:22:10.155997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:10.155997 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 450/904] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:10.159553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.284259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc62441-1dcc-4364-bc04-62aba0682105 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:10.328222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:10.328938 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.329258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.329595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.330267 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:10.330634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:10.332098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:10.347813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 455/905] 10.222.0.75 () {56 vars in 1109 bytes} [Tue Aug 23 23:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:10.356773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.486578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6ff3-004d-4cc8-9814-c0b7e6580a44 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:10.501558 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:10.526401 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:10.527021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.527293 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.527554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.535611 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:10.537124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:22:10.549884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:10.550966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:22:10.552050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: ERROR keystone.server.flask.application Aug 23 23:22:10.556061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 451/906] 10.222.0.75 () {56 vars in 1111 bytes} [Tue Aug 23 23:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:10.558198 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.610552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:10.666840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546671b8-8440-40e8-bd7b-b01d5c331607 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:10.706147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:10.706752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.707028 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.707299 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.708026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:10.708331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:10.709764 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bb3f1-cce4-41d0-a5db-9b56b95ba6e5 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:10.723132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 456/907] 10.222.0.75 () {56 vars in 1148 bytes} [Tue Aug 23 23:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:10.733310 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.841577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3f10-a0fc-42be-9d71-0b89f0f59b97 None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:10.876888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:10.877476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.877747 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.878014 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.878769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] RBAC: Adding query filter params (role.id=63faaaf1760a4a0bad177ee6334a085b, scope.project.id=c8ab3e0badff4106b560d809f6157c2f, user.id=3453fc063e964847aa4aad6c2d4242c2) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:10.879028 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:10.880502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d256cb8-fbfa-4eee-b499-7fe37827cdb1 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:10.894080 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 452/908] 10.222.0.75 () {56 vars in 1374 bytes} [Tue Aug 23 23:22:10 2022] GET /identity/v3/role_assignments?user.id=3453fc063e964847aa4aad6c2d4242c2&scope.project.id=c8ab3e0badff4106b560d809f6157c2f&role.id=63faaaf1760a4a0bad177ee6334a085b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:13.144444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336433a4-3e1f-4baf-8552-929c8f949a3b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:13.145021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336433a4-3e1f-4baf-8552-929c8f949a3b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:13.145021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336433a4-3e1f-4baf-8552-929c8f949a3b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:13.146341 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 457/909] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:13.154502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:13.155207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:13.155432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:13.174133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:13.175347 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:13.209245 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:13.263978 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 453/910] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:22:13.635238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336433a4-3e1f-4baf-8552-929c8f949a3b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:13.772898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336433a4-3e1f-4baf-8552-929c8f949a3b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:13.784953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:13.826925 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:13.827634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:13.827989 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:13.828315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:13.828992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:13.830671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:13.844129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:13.845601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:13.846713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:13.848060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 458/911] 10.222.0.75 () {56 vars in 1117 bytes} [Tue Aug 23 23:22:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:13.852060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:13.962435 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715e24-d066-4fed-b97b-764c9f067a40 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:13.996956 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:13.997575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:13.997851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:13.998119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:13.998750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:13.999052 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:14.000461 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549e1b-945b-46fd-bd7a-c14289da7299 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:14.005538 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 454/912] 10.222.0.75 () {56 vars in 1116 bytes} [Tue Aug 23 23:22:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:14.011859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:14.122416 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0341e-e7d6-493e-910a-635e1f389996 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:14.157867 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:14.158551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:14.158731 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:14.159002 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] PATH_INFO: `/v3/services` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:14.159633 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] RBAC: Adding query filter params (type=placement) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:14.159969 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:14.161348 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7569-f0e4-4f7c-9459-8fc2535257ad None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:14.166030 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 459/913] 10.222.0.75 () {56 vars in 1116 bytes} [Tue Aug 23 23:22:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:16.400175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11717-63d6-44aa-8bdb-cd5d669795b7 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:16.400722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11717-63d6-44aa-8bdb-cd5d669795b7 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:16.400722 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11717-63d6-44aa-8bdb-cd5d669795b7 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:16.402070 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 455/914] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:16.408308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2e24-6128-4aa7-9da9-65116247cd22 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:16.408775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2e24-6128-4aa7-9da9-65116247cd22 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:16.408863 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2e24-6128-4aa7-9da9-65116247cd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:16.428796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ca8f2e24-6128-4aa7-9da9-65116247cd22 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:16.430129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ca8f2e24-6128-4aa7-9da9-65116247cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:16.459940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:16.524970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 460/915] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:22:16.847860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11717-63d6-44aa-8bdb-cd5d669795b7 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:16.893993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:16.985180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11717-63d6-44aa-8bdb-cd5d669795b7 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:17.024528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:17.025460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:17.025703 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:17.026094 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:17.026884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:17.028779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d5c4-0020-4775-a217-3b0e4724cd15 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:17.048534 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 456/916] 10.222.0.75 () {60 vars in 1141 bytes} [Tue Aug 23 23:22:16 2022] POST /identity/v3/services => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:22:19.377208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dc90-b91d-42bf-8483-7441076dc0ea None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:19.377782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dc90-b91d-42bf-8483-7441076dc0ea None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:19.377782 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dc90-b91d-42bf-8483-7441076dc0ea None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:19.379120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 461/917] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:19.386738 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:19.387340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:19.387340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:19.406980 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:19.408232 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:19.496289 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 457/918] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:19 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:22:19.946910 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151dc90-b91d-42bf-8483-7441076dc0ea None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:20.075960 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151dc90-b91d-42bf-8483-7441076dc0ea None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:20.117118 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:20.117773 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.118051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.118325 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.118929 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:20.120501 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:20.130935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:20.132775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:20.133859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 462/919] 10.222.0.75 () {56 vars in 1117 bytes} [Tue Aug 23 23:22:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:22:20.141982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:20.173549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:20.285485 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bee2b-6ae5-4f4e-9efd-6a04358adb50 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:20.332296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:20.333184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.333583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.333897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.334594 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:20.334954 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:20.336451 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:20.342228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 458/920] 10.222.0.75 () {56 vars in 1116 bytes} [Tue Aug 23 23:22:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:20.348761 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:20.385245 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:20.480613 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12ed28-f051-4b32-880a-75fb23a44122 None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:20.521979 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:20.522589 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.522873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.523146 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.523935 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] RBAC: Adding query filter params (interface=public, service_id=30f36124e5bc4515ba572add265cee1f, region_id=RegionOne) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:20.524234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:20.525699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa83f-c70a-49b7-9be3-0ce3e0df7b51 None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:20.533519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 463/921] 10.222.0.75 () {56 vars in 1251 bytes} [Tue Aug 23 23:22:20 2022] GET /identity/v3/endpoints?service_id=30f36124e5bc4515ba572add265cee1f&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:20.541281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:20.643286 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:20.663742 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def0208-74c1-47d6-a10f-1516b016069e None admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:20.705568 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:20.706237 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.706515 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.706775 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.707388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:20.708796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaedc1-90b9-4d39-959f-77dba41e0431 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:20.716086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 459/922] 10.222.0.75 () {56 vars in 1087 bytes} [Tue Aug 23 23:22:20 2022] GET /identity/v3/services => generated 1962 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:22:22.979725 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34506c62-2a62-4c89-ae04-1879c574469f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:22.980387 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34506c62-2a62-4c89-ae04-1879c574469f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:22.980387 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34506c62-2a62-4c89-ae04-1879c574469f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:22.981684 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 464/923] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:22:22.990177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:22.990716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:22.991102 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.013773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:23.015051 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:23.095250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 460/924] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:22:22 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:22:23.425836 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34506c62-2a62-4c89-ae04-1879c574469f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:23.542650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:23.570274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34506c62-2a62-4c89-ae04-1879c574469f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:23.619611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:23.620328 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.620644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.620927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.621703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:23.623320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:22:23.633724 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:22:23.635630 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application with Lock( Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: ERROR keystone.server.flask.application Aug 23 23:22:23.636859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 465/925] 10.222.0.75 () {56 vars in 1117 bytes} [Tue Aug 23 23:22:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:22:23.642902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:23.728993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:23.755790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e5829-09d3-4d85-82e1-9b4055fff427 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:23.798650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:23.799414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.799739 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.800067 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] PATH_INFO: `/v3/services` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.800862 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:22:23.801195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:23.803030 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3ced-4e3f-4ec0-b984-d8139b2ce825 None admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:23.811659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 461/926] 10.222.0.75 () {56 vars in 1116 bytes} [Tue Aug 23 23:22:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:22:23.818027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:23.930634 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd711b2-aa21-4f6e-9c31-62f5ba00737f None admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:23.967216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:23.967830 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.968182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.968606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.969051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:23.970438 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74479a-6fd9-4b77-9d21-f44ba50d926f None admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:24.003419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 466/927] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:22:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:22:33.806299 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=30 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:33.999295 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:30.755211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202160e7-facb-4807-8b3d-953201efa819 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:30.756142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202160e7-facb-4807-8b3d-953201efa819 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:30.756240 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202160e7-facb-4807-8b3d-953201efa819 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:30.757989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 462/928] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:30.763927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e2ca-f2a3-4e4e-a43c-cf35db8dc6a3 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:30.764493 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e2ca-f2a3-4e4e-a43c-cf35db8dc6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:30.764771 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e2ca-f2a3-4e4e-a43c-cf35db8dc6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:30.791210 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-c214e2ca-f2a3-4e4e-a43c-cf35db8dc6a3 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:30.792369 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-c214e2ca-f2a3-4e4e-a43c-cf35db8dc6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:30.901162 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 467/929] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:31.312106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0caf5-9e7e-4c6e-9507-8516f179bbd1 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.312277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0caf5-9e7e-4c6e-9507-8516f179bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.312544 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0caf5-9e7e-4c6e-9507-8516f179bbd1 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.314095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 463/930] 10.222.0.75 () {54 vars in 965 bytes} [Tue Aug 23 23:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:31.320916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593657-0c15-4265-a922-865793c2babe None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.321201 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593657-0c15-4265-a922-865793c2babe None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.321473 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593657-0c15-4265-a922-865793c2babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.401070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-29593657-0c15-4265-a922-865793c2babe None None] MFA Rules not processed for user `d0bad6d774424470a1556d5c4e1db12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:31.402290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-29593657-0c15-4265-a922-865793c2babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:31.501293 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 468/931] 10.222.0.75 () {58 vars in 1062 bytes} [Tue Aug 23 23:23:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:31.513437 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0caf5-9e7e-4c6e-9507-8516f179bbd1 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:31.529069 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0caf5-9e7e-4c6e-9507-8516f179bbd1 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:31.534300 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:31.535321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:31.535966 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:31.536387 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:31.546949 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:31.548560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87dbc0-c218-4af7-bc11-2647dcb2bec3 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:31.560599 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 464/932] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:34.097237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13590d7-707f-4980-b678-bf8b2b3fb076 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.097855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13590d7-707f-4980-b678-bf8b2b3fb076 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.097855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13590d7-707f-4980-b678-bf8b2b3fb076 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.099171 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 469/933] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:34.105211 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5ce9-1ca1-4e60-9d81-1f3cbd7ec9b8 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.105768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5ce9-1ca1-4e60-9d81-1f3cbd7ec9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.105768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c5ce9-1ca1-4e60-9d81-1f3cbd7ec9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.128213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f81c5ce9-1ca1-4e60-9d81-1f3cbd7ec9b8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:34.129559 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f81c5ce9-1ca1-4e60-9d81-1f3cbd7ec9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:34.140147 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 465/934] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:34.558992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13590d7-707f-4980-b678-bf8b2b3fb076 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:34.572320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13590d7-707f-4980-b678-bf8b2b3fb076 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:34.576537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:34.577152 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:34.577440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:34.577716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:34.588662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:34.590168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3ca37-9dad-4b8b-9edc-cc8aac859a4d service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:34.620124 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 470/935] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:37.503846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088725f-2904-411a-aaaa-20f0de8f4e4e None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:37.504649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088725f-2904-411a-aaaa-20f0de8f4e4e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:37.504649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088725f-2904-411a-aaaa-20f0de8f4e4e None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:37.506028 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 466/936] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:37.514103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fc98-f58a-40f2-9b71-f20b3d43ad41 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:37.514681 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fc98-f58a-40f2-9b71-f20b3d43ad41 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:37.515007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fc98-f58a-40f2-9b71-f20b3d43ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:37.572142 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-e601fc98-f58a-40f2-9b71-f20b3d43ad41 None None] MFA Rules not processed for user `b713114121954f8e943dfa1ab5edec54`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:37.573375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-e601fc98-f58a-40f2-9b71-f20b3d43ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:37.633355 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:37.687282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 471/937] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:37 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:38.042622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088725f-2904-411a-aaaa-20f0de8f4e4e None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:38.054857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088725f-2904-411a-aaaa-20f0de8f4e4e None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:38.058634 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:38.059238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:38.059627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:38.059917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:38.069889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:38.071297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7f9cc-e094-40ba-846b-3c42876adf3f service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:38.083120 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 467/938] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:38 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:41.097386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd82e-43e4-4a20-9be9-5bd8a3a93d0e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:41.097896 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd82e-43e4-4a20-9be9-5bd8a3a93d0e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:41.098059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd82e-43e4-4a20-9be9-5bd8a3a93d0e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:41.099624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 472/939] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:41.106119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281879-7659-48c4-959c-16f7889ed1ac None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:41.106661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281879-7659-48c4-959c-16f7889ed1ac None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:41.106661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281879-7659-48c4-959c-16f7889ed1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:41.128287 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-60281879-7659-48c4-959c-16f7889ed1ac None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:41.129478 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-60281879-7659-48c4-959c-16f7889ed1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:41.202307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 468/940] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:41 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:41.561002 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a43d-a991-46c4-ab3a-cba5a4a78d91 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:41.561286 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a43d-a991-46c4-ab3a-cba5a4a78d91 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:41.561567 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a43d-a991-46c4-ab3a-cba5a4a78d91 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:41.563021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 473/941] 10.222.0.75 () {54 vars in 965 bytes} [Tue Aug 23 23:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:41.572755 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e479-59aa-43cd-939c-d2bf0bedf2d6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:41.573041 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e479-59aa-43cd-939c-d2bf0bedf2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:41.573315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e479-59aa-43cd-939c-d2bf0bedf2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:41.593788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d095e479-59aa-43cd-939c-d2bf0bedf2d6 None None] MFA Rules not processed for user `d0bad6d774424470a1556d5c4e1db12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:41.595018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d095e479-59aa-43cd-939c-d2bf0bedf2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:41.601945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 469/942] 10.222.0.75 () {58 vars in 1062 bytes} [Tue Aug 23 23:23:41 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:41.611448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4a43d-a991-46c4-ab3a-cba5a4a78d91 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:41.623915 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4a43d-a991-46c4-ab3a-cba5a4a78d91 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:41.628738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:41.629448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:41.629722 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:41.629996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:41.640407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:41.641891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545ef4b-ef1e-4a77-a6fb-01eb006b81b6 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:41.652879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 474/943] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:41 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:45.126649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d0a-66e7-44e1-958c-51e46f31cb14 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:45.127250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d0a-66e7-44e1-958c-51e46f31cb14 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:45.127250 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d0a-66e7-44e1-958c-51e46f31cb14 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:45.129112 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 470/944] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:45.135507 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e607-8d94-435c-8c3c-be24a0a0d302 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:45.136040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e607-8d94-435c-8c3c-be24a0a0d302 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:45.136155 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e607-8d94-435c-8c3c-be24a0a0d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:45.156746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-1445e607-8d94-435c-8c3c-be24a0a0d302 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:45.158421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-1445e607-8d94-435c-8c3c-be24a0a0d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:45.167715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 475/945] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:45.519503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498d0a-66e7-44e1-958c-51e46f31cb14 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:45.530867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498d0a-66e7-44e1-958c-51e46f31cb14 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:45.535735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:45.536370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:45.536639 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:45.536905 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:45.546833 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:45.548581 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870c5e8-2d38-4f35-ac12-ac2156c148ed service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:45.560017 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 471/946] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:48.005758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40487f-44c7-4060-a343-bc59c427265c None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:48.006356 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40487f-44c7-4060-a343-bc59c427265c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:48.006666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40487f-44c7-4060-a343-bc59c427265c None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:48.009229 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 476/947] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:23:48.015589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2aa62-6eef-4651-ba40-6682fe187b57 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:48.016177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2aa62-6eef-4651-ba40-6682fe187b57 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:48.016177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2aa62-6eef-4651-ba40-6682fe187b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:48.045945 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-07f2aa62-6eef-4651-ba40-6682fe187b57 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:48.047425 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-07f2aa62-6eef-4651-ba40-6682fe187b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:48.056963 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 472/948] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:48.409816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40487f-44c7-4060-a343-bc59c427265c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:48.427189 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40487f-44c7-4060-a343-bc59c427265c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:48.433602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:48.434244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:48.434485 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:48.434751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:48.445419 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:48.446923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931a485-62b1-4eb5-867e-8b18c1ef932b service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:48.458460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 477/949] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:50.884363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f467-ba15-426f-838f-0f666039a719 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:50.884921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f467-ba15-426f-838f-0f666039a719 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:50.884921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955f467-ba15-426f-838f-0f666039a719 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:50.886443 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 473/950] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:50.893547 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963d69-ae71-4731-ac6a-d4c687aace85 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:50.894129 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963d69-ae71-4731-ac6a-d4c687aace85 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:50.894478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963d69-ae71-4731-ac6a-d4c687aace85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:50.921514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-bf963d69-ae71-4731-ac6a-d4c687aace85 None None] MFA Rules not processed for user `b713114121954f8e943dfa1ab5edec54`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:50.922824 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-bf963d69-ae71-4731-ac6a-d4c687aace85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:50.934086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 478/951] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:50 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:51.306730 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955f467-ba15-426f-838f-0f666039a719 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:51.322825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955f467-ba15-426f-838f-0f666039a719 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:51.327842 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:51.328572 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:51.328871 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:51.329212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:51.342787 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:51.345064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06f7ef-2581-4847-b386-82aeb3a5d84f service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:51.361267 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 474/952] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:51 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:54.175706 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d0ba-a253-4f0e-8e06-1aaa5113dec1 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.176421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d0ba-a253-4f0e-8e06-1aaa5113dec1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.176421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d0ba-a253-4f0e-8e06-1aaa5113dec1 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.178188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 479/953] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:54.184397 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2ff3-4840-4648-8813-75658d425afb None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.184972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2ff3-4840-4648-8813-75658d425afb None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.184972 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae2ff3-4840-4648-8813-75658d425afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.194799 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=65 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:54.220125 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-dfae2ff3-4840-4648-8813-75658d425afb None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.222185 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-dfae2ff3-4840-4648-8813-75658d425afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.237106 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 475/954] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:54.584675 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66d0ba-a253-4f0e-8e06-1aaa5113dec1 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.606274 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66d0ba-a253-4f0e-8e06-1aaa5113dec1 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.611572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.612266 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.612539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.612806 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.623537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.625050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a22d-076c-45a2-b8fd-7c626cc3ef62 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.636763 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 480/955] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:57.138947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda45-98f7-4ce2-bd0a-f377f1c97329 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:57.139530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda45-98f7-4ce2-bd0a-f377f1c97329 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:57.139530 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dda45-98f7-4ce2-bd0a-f377f1c97329 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:57.140848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 476/956] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:57.146560 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc25-ba24-42a3-a6c3-a0f4dd740de3 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:57.147120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc25-ba24-42a3-a6c3-a0f4dd740de3 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:57.147120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc25-ba24-42a3-a6c3-a0f4dd740de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:57.169294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-cdf8fc25-ba24-42a3-a6c3-a0f4dd740de3 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:57.170525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-cdf8fc25-ba24-42a3-a6c3-a0f4dd740de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:57.180289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 481/957] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:23:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:57.540761 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dda45-98f7-4ce2-bd0a-f377f1c97329 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:57.553104 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dda45-98f7-4ce2-bd0a-f377f1c97329 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:57.557213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:57.557907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:57.558243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:57.558576 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:57.570936 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:57.572580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeb7f8-dc40-4c78-bb61-b5b1167fd80c service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:57.587453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 477/958] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:00.426815 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c9b2-2b90-4ba5-8dd1-13b622ad589b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.427619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c9b2-2b90-4ba5-8dd1-13b622ad589b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.427619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c9b2-2b90-4ba5-8dd1-13b622ad589b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.428859 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 482/959] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:00.435009 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e669cd-57ef-4c0f-a4c9-d983e100d015 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.435761 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e669cd-57ef-4c0f-a4c9-d983e100d015 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.435761 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e669cd-57ef-4c0f-a4c9-d983e100d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.456511 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-84e669cd-57ef-4c0f-a4c9-d983e100d015 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:00.457754 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-84e669cd-57ef-4c0f-a4c9-d983e100d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:00.465851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 478/960] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:00.813867 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8c9b2-2b90-4ba5-8dd1-13b622ad589b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.826480 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8c9b2-2b90-4ba5-8dd1-13b622ad589b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.830436 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.831058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.831332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.831599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.842347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.843828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3bc0-5eac-43cc-9641-73fd78bd66b8 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.855237 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 483/961] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:00 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:05.420976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadd174-f821-4bd2-a47a-04e93feda4b3 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:05.421665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadd174-f821-4bd2-a47a-04e93feda4b3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:05.421665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadd174-f821-4bd2-a47a-04e93feda4b3 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:05.423415 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 479/962] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:05.429741 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781ed3-415d-4a1d-a57b-b11964b79516 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:05.430335 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781ed3-415d-4a1d-a57b-b11964b79516 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:05.430520 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781ed3-415d-4a1d-a57b-b11964b79516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:05.452458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f1781ed3-415d-4a1d-a57b-b11964b79516 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:05.453796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f1781ed3-415d-4a1d-a57b-b11964b79516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:05.463116 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 484/963] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:05.810472 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadd174-f821-4bd2-a47a-04e93feda4b3 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:05.823494 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadd174-f821-4bd2-a47a-04e93feda4b3 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:05.827143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:05.827744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:05.828133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:05.828560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:05.838379 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:05.839823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ca66e-2afc-411a-8da0-aeee6b02edbf service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:05.850719 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 480/964] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:08.772873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b379-557f-4cad-afa9-110232501460 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:08.773448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b379-557f-4cad-afa9-110232501460 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:08.773448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b379-557f-4cad-afa9-110232501460 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:08.774751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 485/965] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:08.780305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14782-f436-4499-b6b6-d9e1a487bad8 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:08.780768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14782-f436-4499-b6b6-d9e1a487bad8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:08.780869 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d14782-f436-4499-b6b6-d9e1a487bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:08.800999 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-70d14782-f436-4499-b6b6-d9e1a487bad8 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:08.802593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-70d14782-f436-4499-b6b6-d9e1a487bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:08.810521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 481/966] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:09.158182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b379-557f-4cad-afa9-110232501460 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:09.171079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=48 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:09.176347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3b379-557f-4cad-afa9-110232501460 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:09.181174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:09.181800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:09.182080 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:09.182359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.193141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:09.194750 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f2eb-2aee-4d9e-8ec3-6d2c3df3eaec service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:09.206715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 486/967] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:09 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:13.652028 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeba79-0ff0-42eb-9bac-c1bfed21b487 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:13.652590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeba79-0ff0-42eb-9bac-c1bfed21b487 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:13.652590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeba79-0ff0-42eb-9bac-c1bfed21b487 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:13.653896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 482/968] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:13.659551 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ce11-4144-47c1-aeb8-6280634b4b74 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:13.660091 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ce11-4144-47c1-aeb8-6280634b4b74 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:13.660375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ce11-4144-47c1-aeb8-6280634b4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:13.688740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-3425ce11-4144-47c1-aeb8-6280634b4b74 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:13.690049 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-3425ce11-4144-47c1-aeb8-6280634b4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:13.698972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 487/969] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:14.041889 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afeba79-0ff0-42eb-9bac-c1bfed21b487 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:14.054272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afeba79-0ff0-42eb-9bac-c1bfed21b487 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:14.058510 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:14.059189 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:14.059613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:14.059916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:14.070090 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:14.071540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841744-4f15-4eb5-a11c-8cfbd407961e service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:14.083614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 483/970] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:20.069882 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fffe9-f8c1-44ce-9f67-97ab1a91c2a2 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.070364 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fffe9-f8c1-44ce-9f67-97ab1a91c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.070442 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fffe9-f8c1-44ce-9f67-97ab1a91c2a2 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.072418 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 488/971] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:20.078021 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10615-74d0-4c64-b2f4-b1f1e08c3750 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.079812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10615-74d0-4c64-b2f4-b1f1e08c3750 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.080362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10615-74d0-4c64-b2f4-b1f1e08c3750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.175304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-6fb10615-74d0-4c64-b2f4-b1f1e08c3750 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:20.176465 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-6fb10615-74d0-4c64-b2f4-b1f1e08c3750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.381477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 484/972] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:24:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:24:23.683192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=8 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:25.259282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b398c-80c4-4f7f-b828-41836a58d74b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:25.260474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b398c-80c4-4f7f-b828-41836a58d74b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:25.261017 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b398c-80c4-4f7f-b828-41836a58d74b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:25.262432 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 489/973] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:25.269564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675404d-3b79-4690-9c3c-a4284cffdf46 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:25.270123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675404d-3b79-4690-9c3c-a4284cffdf46 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:25.270456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675404d-3b79-4690-9c3c-a4284cffdf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:25.294405 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=66 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:25.297223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-9675404d-3b79-4690-9c3c-a4284cffdf46 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:25.298853 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-9675404d-3b79-4690-9c3c-a4284cffdf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:25.312086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 485/974] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:24:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:27.214899 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e93da-cb98-4bc5-97b1-41e856f37ef5 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:27.215478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e93da-cb98-4bc5-97b1-41e856f37ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:27.215478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e93da-cb98-4bc5-97b1-41e856f37ef5 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:27.216987 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 490/975] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:27.223779 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71718ee-ac04-4b77-903e-14afe008e3cc None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:27.224392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71718ee-ac04-4b77-903e-14afe008e3cc None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:27.224392 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71718ee-ac04-4b77-903e-14afe008e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:27.246652 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e71718ee-ac04-4b77-903e-14afe008e3cc None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:27.247996 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e71718ee-ac04-4b77-903e-14afe008e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:27.258635 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 486/976] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:24:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:31.462120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988417e3-9713-41f8-ae5c-a7fac6ea1e2b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:31.462926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988417e3-9713-41f8-ae5c-a7fac6ea1e2b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:31.462926 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988417e3-9713-41f8-ae5c-a7fac6ea1e2b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:31.464249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 491/977] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:24:31.474583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06092-6dfb-4486-85f2-ef4619f1e6f9 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:31.475442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06092-6dfb-4486-85f2-ef4619f1e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:31.475442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec06092-6dfb-4486-85f2-ef4619f1e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:31.514237 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-aec06092-6dfb-4486-85f2-ef4619f1e6f9 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:31.515911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-aec06092-6dfb-4486-85f2-ef4619f1e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:31.533230 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 487/978] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:32.052727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-ce34-4747-823d-c8260d6abf15 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.053575 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-ce34-4747-823d-c8260d6abf15 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.054056 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b93b-ce34-4747-823d-c8260d6abf15 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.056582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 492/979] 10.222.0.75 () {54 vars in 962 bytes} [Tue Aug 23 23:24:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:32.067680 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14ad0-fc2c-4fd5-aa37-d3a729065b18 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.068594 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14ad0-fc2c-4fd5-aa37-d3a729065b18 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.069174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14ad0-fc2c-4fd5-aa37-d3a729065b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.122064 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-22b14ad0-fc2c-4fd5-aa37-d3a729065b18 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:32.123353 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-22b14ad0-fc2c-4fd5-aa37-d3a729065b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:32.206605 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 488/980] 10.222.0.75 () {58 vars in 1059 bytes} [Tue Aug 23 23:24:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:32.215759 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b93b-ce34-4747-823d-c8260d6abf15 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:32.232181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b93b-ce34-4747-823d-c8260d6abf15 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:32.237406 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:32.238280 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:32.238794 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:32.239119 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:32.248919 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:32.251284 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d67d5-8da1-423f-9cf9-f88c5a8109b4 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:32.262043 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 493/981] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:34.894278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe8b7-2c95-4835-9149-dfa0c8107ac4 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:34.894848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe8b7-2c95-4835-9149-dfa0c8107ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:34.895029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe8b7-2c95-4835-9149-dfa0c8107ac4 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:34.896504 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 489/982] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:34.902060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80958f-cbb8-4940-90e0-534b70af43b7 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:34.902516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80958f-cbb8-4940-90e0-534b70af43b7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:34.902604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80958f-cbb8-4940-90e0-534b70af43b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:34.924648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-eb80958f-cbb8-4940-90e0-534b70af43b7 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:34.925833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-eb80958f-cbb8-4940-90e0-534b70af43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:34.934076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 494/983] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:35.325589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe8b7-2c95-4835-9149-dfa0c8107ac4 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:35.341054 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe8b7-2c95-4835-9149-dfa0c8107ac4 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:35.346784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:35.347465 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:35.347986 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:35.348403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:35.357815 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:35.359782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be235f-dd6f-4ecb-8f76-5a76d5c8fc9e service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:35.370261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 490/984] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:38.360505 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef1b-786d-4873-ad2e-afd7cfe9cf27 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.361243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef1b-786d-4873-ad2e-afd7cfe9cf27 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.361243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ef1b-786d-4873-ad2e-afd7cfe9cf27 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.362485 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 495/985] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:38.368377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5c0e-e2ef-46b0-848b-d82a080af5fe None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.368863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5c0e-e2ef-46b0-848b-d82a080af5fe None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.368968 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5c0e-e2ef-46b0-848b-d82a080af5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.389728 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-5d3c5c0e-e2ef-46b0-848b-d82a080af5fe None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:38.391122 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-5d3c5c0e-e2ef-46b0-848b-d82a080af5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:38.401261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 491/986] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:38.776012 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889996-5364-4e7c-a502-0d8fcb65a5f8 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.776291 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889996-5364-4e7c-a502-0d8fcb65a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.776789 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889996-5364-4e7c-a502-0d8fcb65a5f8 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.778179 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 496/987] 10.222.0.75 () {54 vars in 962 bytes} [Tue Aug 23 23:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:38.785453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343bdad-beec-482c-a5f4-7aab13a121b2 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.786001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343bdad-beec-482c-a5f4-7aab13a121b2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.786501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343bdad-beec-482c-a5f4-7aab13a121b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.811860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-3343bdad-beec-482c-a5f4-7aab13a121b2 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:38.813181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-3343bdad-beec-482c-a5f4-7aab13a121b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:38.833158 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 492/988] 10.222.0.75 () {58 vars in 1059 bytes} [Tue Aug 23 23:24:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:38.833737 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a889996-5364-4e7c-a502-0d8fcb65a5f8 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:38.850946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a889996-5364-4e7c-a502-0d8fcb65a5f8 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:38.857990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:38.859353 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.859622 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.860106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.872146 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:38.876099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997144b1-ab7e-418d-83f5-a22b7843ebf5 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:38.897151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 497/989] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:41.355603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9913-422f-4dc0-801c-c8a9f5c78eeb None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:41.356513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9913-422f-4dc0-801c-c8a9f5c78eeb None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:41.356941 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9913-422f-4dc0-801c-c8a9f5c78eeb None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:41.359246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 493/990] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:41.365315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f715e-4751-4635-88f7-f62398703c4d None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:41.366183 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f715e-4751-4635-88f7-f62398703c4d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:41.366635 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f715e-4751-4635-88f7-f62398703c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:41.389304 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-507f715e-4751-4635-88f7-f62398703c4d None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:41.390946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-507f715e-4751-4635-88f7-f62398703c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:41.412667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 498/991] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:41.789720 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9913-422f-4dc0-801c-c8a9f5c78eeb None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:41.814935 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9913-422f-4dc0-801c-c8a9f5c78eeb None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:41.824464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:41.825826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:41.826585 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:41.827263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:41.843729 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:41.847061 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e5ff-3b3d-449c-ab08-1f98df3c6289 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:41.877323 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 494/992] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:43.021992 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784cca-52d0-457d-b389-dfd080b992c6 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.022430 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784cca-52d0-457d-b389-dfd080b992c6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.022648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784cca-52d0-457d-b389-dfd080b992c6 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.029977 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ae20-796f-4059-9260-241fb740f54f None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.030400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ae20-796f-4059-9260-241fb740f54f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.030564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ae20-796f-4059-9260-241fb740f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.032942 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 499/993] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:43.068532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d7a6ae20-796f-4059-9260-241fb740f54f None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:43.072344 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d7a6ae20-796f-4059-9260-241fb740f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:43.088758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 495/994] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:43.724902 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae59e-39ed-4049-89e6-8b9a8c16970c None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.725239 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae59e-39ed-4049-89e6-8b9a8c16970c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.725525 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ae59e-39ed-4049-89e6-8b9a8c16970c None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.727127 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 500/995] 10.222.0.75 () {54 vars in 964 bytes} [Tue Aug 23 23:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:43.732466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052f6-2593-436a-be31-bc8f81a6577a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.732982 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052f6-2593-436a-be31-bc8f81a6577a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.733872 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052f6-2593-436a-be31-bc8f81a6577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.776477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-708052f6-2593-436a-be31-bc8f81a6577a None None] MFA Rules not processed for user `a4243bac39ca441498a5fc88927c6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:43.777750 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-708052f6-2593-436a-be31-bc8f81a6577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:43.849711 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=100 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:43.864247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 496/996] 10.222.0.75 () {58 vars in 1061 bytes} [Tue Aug 23 23:24:43 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:43.865243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ae59e-39ed-4049-89e6-8b9a8c16970c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:43.877727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ae59e-39ed-4049-89e6-8b9a8c16970c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:43.882297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4243bac39ca441498a5fc88927c6dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:43.883120 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:43.883583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:43.884099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:43.895387 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:43.897151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014700-c058-4245-ab71-1172340bebeb service cinder] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:43.908058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 501/997] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:44.192758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2108-9ac5-4a93-b3e0-86fca7fa3a36 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:44.193329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2108-9ac5-4a93-b3e0-86fca7fa3a36 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:44.193329 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2108-9ac5-4a93-b3e0-86fca7fa3a36 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:44.194789 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 497/998] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:44.200607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11102-560c-4cb2-86a3-66ad1446faf0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:44.201104 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11102-560c-4cb2-86a3-66ad1446faf0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:44.201350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11102-560c-4cb2-86a3-66ad1446faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:44.222110 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-05b11102-560c-4cb2-86a3-66ad1446faf0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:44.223306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-05b11102-560c-4cb2-86a3-66ad1446faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:44.239975 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 502/999] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:44.614612 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2108-9ac5-4a93-b3e0-86fca7fa3a36 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:44.631389 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2108-9ac5-4a93-b3e0-86fca7fa3a36 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:44.637156 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:44.637901 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:44.638331 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:44.638659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:44.649867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:44.651634 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d30e3b-313a-49da-bf59-46d0972c8422 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:44.663898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 498/1000] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:47.004729 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce70b5-ec34-471d-b76b-2e6dac13531f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:47.005262 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce70b5-ec34-471d-b76b-2e6dac13531f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:47.005262 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce70b5-ec34-471d-b76b-2e6dac13531f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:47.006704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 503/1001] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:47.012893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993eb4-9bfc-47f7-a14c-611a381b0d4e None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:47.013439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993eb4-9bfc-47f7-a14c-611a381b0d4e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:47.013439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993eb4-9bfc-47f7-a14c-611a381b0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:47.034999 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-83993eb4-9bfc-47f7-a14c-611a381b0d4e None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:47.036268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-83993eb4-9bfc-47f7-a14c-611a381b0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:47.046884 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 499/1002] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:47.395423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce70b5-ec34-471d-b76b-2e6dac13531f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:47.411049 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce70b5-ec34-471d-b76b-2e6dac13531f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:47.417154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:47.417756 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:47.418044 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:47.418311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:47.427965 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:47.429585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001c5c-890b-4985-a3ea-e1cf57a139c9 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:47.441438 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 504/1003] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:49.732887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7872-2413-4771-b04a-01bc5fe6e2b8 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:49.732887 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7872-2413-4771-b04a-01bc5fe6e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:49.733601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7872-2413-4771-b04a-01bc5fe6e2b8 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:49.734432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 500/1004] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:49.740087 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7aee-7868-4c75-99e4-6a168b2a76f6 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:49.740512 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7aee-7868-4c75-99e4-6a168b2a76f6 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:49.740628 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7aee-7868-4c75-99e4-6a168b2a76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:49.765332 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-c2ef7aee-7868-4c75-99e4-6a168b2a76f6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:49.766646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-c2ef7aee-7868-4c75-99e4-6a168b2a76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:49.779917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 505/1005] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:50.125226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7872-2413-4771-b04a-01bc5fe6e2b8 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:50.148747 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7872-2413-4771-b04a-01bc5fe6e2b8 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:50.158575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:50.159648 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:50.160407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:50.161207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:50.176404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:50.178413 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75da35-d649-4d9b-9708-162eaa773584 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:50.190103 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 501/1006] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:52.488806 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c72e6-19df-4e8d-ba66-f23fd94b6304 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:52.489472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c72e6-19df-4e8d-ba66-f23fd94b6304 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:52.489472 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c72e6-19df-4e8d-ba66-f23fd94b6304 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:52.496261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf77a7-f63a-4d88-96f3-b6ed977a5948 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:52.496261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf77a7-f63a-4d88-96f3-b6ed977a5948 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:52.497002 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf77a7-f63a-4d88-96f3-b6ed977a5948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:52.500222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 506/1007] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:52.518081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-f4cf77a7-f63a-4d88-96f3-b6ed977a5948 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:52.519989 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-f4cf77a7-f63a-4d88-96f3-b6ed977a5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:52.544812 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 502/1008] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:24:52.893232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c72e6-19df-4e8d-ba66-f23fd94b6304 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:52.907624 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c72e6-19df-4e8d-ba66-f23fd94b6304 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:52.912776 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:52.913398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:52.913683 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:52.914051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:52.923537 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:52.925192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690edf9-d912-4c41-8dde-ac1aea9dda88 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:52.936559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 507/1009] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:55.599976 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d742-9147-4ac2-99f4-8a8bddb2dbde None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:55.600628 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d742-9147-4ac2-99f4-8a8bddb2dbde None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:55.601097 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d742-9147-4ac2-99f4-8a8bddb2dbde None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:55.602477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 503/1010] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:55.607856 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba751-9509-4db9-b6be-79618b5bec63 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:55.608377 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba751-9509-4db9-b6be-79618b5bec63 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:55.608478 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba751-9509-4db9-b6be-79618b5bec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:55.615923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=43 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:55.634711 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-7dcba751-9509-4db9-b6be-79618b5bec63 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:55.636853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-7dcba751-9509-4db9-b6be-79618b5bec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:55.648483 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 508/1011] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:56.017531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202d742-9147-4ac2-99f4-8a8bddb2dbde None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:56.037131 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202d742-9147-4ac2-99f4-8a8bddb2dbde None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:56.043706 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:56.044522 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:56.044809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:56.045086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:56.055461 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:56.057371 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f37980-7c4e-4f90-ac21-0c88d62d7163 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:56.068655 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 504/1012] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:59.074794 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97046-531c-46e7-a2ee-aee946e04bf7 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:59.075558 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97046-531c-46e7-a2ee-aee946e04bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:59.075558 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97046-531c-46e7-a2ee-aee946e04bf7 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:59.076923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 509/1013] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:24:59.082947 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c610bf-db81-4f32-9fe7-7387acf60dfa None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:59.083520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c610bf-db81-4f32-9fe7-7387acf60dfa None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:59.083520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c610bf-db81-4f32-9fe7-7387acf60dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:59.104174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-42c610bf-db81-4f32-9fe7-7387acf60dfa None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:59.105409 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-42c610bf-db81-4f32-9fe7-7387acf60dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:59.115481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 505/1014] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:24:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:59.467515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97046-531c-46e7-a2ee-aee946e04bf7 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:59.489587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97046-531c-46e7-a2ee-aee946e04bf7 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:59.494945 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:59.495592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:59.495927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:59.496203 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:59.505608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:59.507195 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00946f-9ee1-4f25-af81-bc37549ce4f2 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:59.517350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 510/1015] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:00.574180 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3112a3-0278-4572-a8e5-e7baad8ea1c8 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:00.574788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3112a3-0278-4572-a8e5-e7baad8ea1c8 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:00.574788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3112a3-0278-4572-a8e5-e7baad8ea1c8 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:00.576139 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 506/1016] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:00.582718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc434-ef1b-4609-b33b-4a1fbe4ffc97 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:00.583287 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc434-ef1b-4609-b33b-4a1fbe4ffc97 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:00.583287 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc434-ef1b-4609-b33b-4a1fbe4ffc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:00.604874 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9bccc434-ef1b-4609-b33b-4a1fbe4ffc97 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:00.606075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9bccc434-ef1b-4609-b33b-4a1fbe4ffc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:00.618000 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 511/1017] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:00.987825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96686-927e-4cc0-8ca6-0637a1ac6637 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:00.988113 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96686-927e-4cc0-8ca6-0637a1ac6637 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:00.988385 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96686-927e-4cc0-8ca6-0637a1ac6637 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:00.989756 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 507/1018] 10.222.0.75 () {54 vars in 967 bytes} [Tue Aug 23 23:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:00.995064 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e08-c8e6-4819-a342-8be98be04568 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:00.995360 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e08-c8e6-4819-a342-8be98be04568 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:00.995655 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e08-c8e6-4819-a342-8be98be04568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:01.038063 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-64d92e08-c8e6-4819-a342-8be98be04568 None None] MFA Rules not processed for user `84548f065a0240e2b700b2c9eecb8bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:01.039307 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-64d92e08-c8e6-4819-a342-8be98be04568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:01.105482 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 512/1019] 10.222.0.75 () {58 vars in 1064 bytes} [Tue Aug 23 23:25:00 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:01.113930 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96686-927e-4cc0-8ca6-0637a1ac6637 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:01.126281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96686-927e-4cc0-8ca6-0637a1ac6637 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:01.130026 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84548f065a0240e2b700b2c9eecb8bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:01.130723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:01.131000 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:01.131275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:01.141686 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:01.143150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bc243-8705-470f-8aed-8d7bc5c867be service glance] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:01.154574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 508/1020] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:01.803131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b9b5-6c57-4e23-a999-b6608a872c14 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:01.803788 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b9b5-6c57-4e23-a999-b6608a872c14 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:01.803911 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896b9b5-6c57-4e23-a999-b6608a872c14 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:01.805414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 513/1021] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:01.811340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad535-c3b5-4513-a72d-08e21ce1040f None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:01.811958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad535-c3b5-4513-a72d-08e21ce1040f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:01.812071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad535-c3b5-4513-a72d-08e21ce1040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:01.833234 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-4b6ad535-c3b5-4513-a72d-08e21ce1040f None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:01.834550 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-4b6ad535-c3b5-4513-a72d-08e21ce1040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:01.845908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 509/1022] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:02.195316 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896b9b5-6c57-4e23-a999-b6608a872c14 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:02.211613 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896b9b5-6c57-4e23-a999-b6608a872c14 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:02.225453 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:02.226103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:02.226381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:02.226648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:02.236648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:02.238244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3e5d9-bbe3-4fb9-88ba-6004e7985ba8 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:02.248539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 514/1023] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:04.675607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7708-d5b3-428c-bc55-3090aee1ad05 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:04.676276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7708-d5b3-428c-bc55-3090aee1ad05 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:04.676276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7708-d5b3-428c-bc55-3090aee1ad05 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:04.677622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 510/1024] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:04.683482 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd948-b39f-415e-8983-d0a8a11aa161 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:04.684132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd948-b39f-415e-8983-d0a8a11aa161 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:04.684359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd948-b39f-415e-8983-d0a8a11aa161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:04.707013 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-dcfcd948-b39f-415e-8983-d0a8a11aa161 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:04.708289 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-dcfcd948-b39f-415e-8983-d0a8a11aa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:04.717048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 515/1025] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:25:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:05.109521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7708-d5b3-428c-bc55-3090aee1ad05 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:05.125782 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7708-d5b3-428c-bc55-3090aee1ad05 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:05.131492 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:05.132176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:05.132462 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:05.132734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:05.144429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:05.146565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b6cc5-be8e-43fb-aac2-1e991a859737 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:05.160316 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 511/1026] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:14.703121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=53 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:15.153508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=43 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:17.180077 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a812f05-284b-4e1c-9cb2-ad86785bc431 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:17.180786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a812f05-284b-4e1c-9cb2-ad86785bc431 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:17.180786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a812f05-284b-4e1c-9cb2-ad86785bc431 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:17.181990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 516/1027] 10.222.0.75 () {54 vars in 918 bytes} [Tue Aug 23 23:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:17.187521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00fa3-22e0-4c54-aa91-4860333d13e6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:17.188081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00fa3-22e0-4c54-aa91-4860333d13e6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:17.188081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00fa3-22e0-4c54-aa91-4860333d13e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:17.216943 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-16f00fa3-22e0-4c54-aa91-4860333d13e6 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:17.218231 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-16f00fa3-22e0-4c54-aa91-4860333d13e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:17.228157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 512/1028] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Aug 23 23:25:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:17.242658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dce4-b80a-4f16-bd31-43707ea6cab5 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:17.242946 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dce4-b80a-4f16-bd31-43707ea6cab5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:17.243219 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801dce4-b80a-4f16-bd31-43707ea6cab5 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:17.244607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 517/1029] 10.222.0.75 () {54 vars in 918 bytes} [Tue Aug 23 23:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:17.249617 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5716-d1b6-4e41-897f-22a3e292fbcf None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:17.250394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5716-d1b6-4e41-897f-22a3e292fbcf None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:17.250756 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b5716-d1b6-4e41-897f-22a3e292fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:17.279223 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-af4b5716-d1b6-4e41-897f-22a3e292fbcf None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:17.280774 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-af4b5716-d1b6-4e41-897f-22a3e292fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:17.294464 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 513/1030] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Aug 23 23:25:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:20.026515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5ac70-a29d-47b9-8752-1284ba8d7111 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:20.027105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5ac70-a29d-47b9-8752-1284ba8d7111 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:20.027105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5ac70-a29d-47b9-8752-1284ba8d7111 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:20.028508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 518/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:20.034166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d275-83e3-416f-ba2c-9cdc9031e7d3 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:20.034632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d275-83e3-416f-ba2c-9cdc9031e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:20.034758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66d275-83e3-416f-ba2c-9cdc9031e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:20.055238 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-9d66d275-83e3-416f-ba2c-9cdc9031e7d3 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:20.056460 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-9d66d275-83e3-416f-ba2c-9cdc9031e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:20.065263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 514/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:20.409953 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5ac70-a29d-47b9-8752-1284ba8d7111 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:20.432566 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5ac70-a29d-47b9-8752-1284ba8d7111 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:20.440294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:20.440907 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:20.441182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:20.441452 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:20.454922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:20.457375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa7fc-0c02-4aea-82f1-0445b5a29d60 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:20.470939 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 519/1033] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:21.460578 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d398d5-d711-45ee-be5c-e89f7094f114 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:21.461161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d398d5-d711-45ee-be5c-e89f7094f114 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:21.461161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d398d5-d711-45ee-be5c-e89f7094f114 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:21.463083 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 515/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:21.468791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52096-4742-4c31-b79b-e546fc55690c None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:21.469278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52096-4742-4c31-b79b-e546fc55690c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:21.469381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52096-4742-4c31-b79b-e546fc55690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:21.490794 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-48f52096-4742-4c31-b79b-e546fc55690c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:21.492019 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-48f52096-4742-4c31-b79b-e546fc55690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:21.501885 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 520/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:21.723411 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d398d5-d711-45ee-be5c-e89f7094f114 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:21.738304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d398d5-d711-45ee-be5c-e89f7094f114 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:21.743837 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:21.744470 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:21.744759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:21.745018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:21.754431 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:21.756055 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c2f0-6c9a-4978-9ec2-442242d836bb service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:21.766060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 516/1036] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:22.709735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775a54-d243-4a09-84a8-e13a62044252 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:22.710649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775a54-d243-4a09-84a8-e13a62044252 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:22.710649 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775a54-d243-4a09-84a8-e13a62044252 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:22.712807 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 521/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:22.720421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d074-f36c-469e-bb5d-86a7b42d6382 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:22.720959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d074-f36c-469e-bb5d-86a7b42d6382 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:22.720959 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99d074-f36c-469e-bb5d-86a7b42d6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:22.754027 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-9f99d074-f36c-469e-bb5d-86a7b42d6382 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:22.755824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-9f99d074-f36c-469e-bb5d-86a7b42d6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:22.765407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 517/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:22.930916 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775a54-d243-4a09-84a8-e13a62044252 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:22.955862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775a54-d243-4a09-84a8-e13a62044252 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:22.962207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:22.962822 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:22.963101 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:22.963371 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:22.974886 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:22.977059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03355-6a19-4e22-869d-dd0cfb7e4370 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:22.989556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 522/1039] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:23.917657 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb707a-02f4-4e68-8a69-c5aaa5ee0ef6 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:23.918235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb707a-02f4-4e68-8a69-c5aaa5ee0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:23.918235 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb707a-02f4-4e68-8a69-c5aaa5ee0ef6 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:23.919593 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 518/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:23.924955 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e23a-7aee-4270-a63b-957bedb0c926 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:23.925450 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e23a-7aee-4270-a63b-957bedb0c926 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:23.925544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031e23a-7aee-4270-a63b-957bedb0c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:23.956591 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2031e23a-7aee-4270-a63b-957bedb0c926 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:23.958550 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2031e23a-7aee-4270-a63b-957bedb0c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:23.970346 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 523/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:24.128805 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb707a-02f4-4e68-8a69-c5aaa5ee0ef6 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:24.148066 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb707a-02f4-4e68-8a69-c5aaa5ee0ef6 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:24.155565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:24.156676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:24.157260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:24.157693 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:24.169790 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:24.172162 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352c6e-2034-4e2e-a418-1245d4dcfd73 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:24.186824 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 519/1042] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:25.076075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a45c-0d23-486f-9cf6-86e94690b478 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:25.076657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a45c-0d23-486f-9cf6-86e94690b478 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:25.076657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a45c-0d23-486f-9cf6-86e94690b478 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:25.078051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 524/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:25.087863 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd752-306c-499e-b604-b2aaa92804ea None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:25.088650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd752-306c-499e-b604-b2aaa92804ea None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:25.088828 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd752-306c-499e-b604-b2aaa92804ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:25.115714 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-cc0cd752-306c-499e-b604-b2aaa92804ea None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:25.116964 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-cc0cd752-306c-499e-b604-b2aaa92804ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:25.126709 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 520/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:25.283665 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a45c-0d23-486f-9cf6-86e94690b478 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:25.299813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a45c-0d23-486f-9cf6-86e94690b478 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:25.305371 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:25.306010 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:25.306279 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:25.306544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:25.316344 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:25.317932 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbae00-19ff-4571-9eda-2960c312c1dd service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:25.327599 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 525/1045] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:26.177145 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28db-b49f-4d9a-815c-ebd180707cef None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:26.177726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28db-b49f-4d9a-815c-ebd180707cef None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:26.177726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28db-b49f-4d9a-815c-ebd180707cef None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:26.179008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 521/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:26.185159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a884-c95f-4aa1-a338-7f0fc7c67e6b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:26.185596 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a884-c95f-4aa1-a338-7f0fc7c67e6b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:26.185716 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a884-c95f-4aa1-a338-7f0fc7c67e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:26.206818 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ab58a884-c95f-4aa1-a338-7f0fc7c67e6b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:26.208047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ab58a884-c95f-4aa1-a338-7f0fc7c67e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:26.217337 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 526/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:26.386521 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f28db-b49f-4d9a-815c-ebd180707cef None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:26.401511 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f28db-b49f-4d9a-815c-ebd180707cef None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:26.407592 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:26.408292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:26.408596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:26.408866 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:26.417620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:26.419246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e792b-0cbd-43fc-af02-5e73b5b48746 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:26.429174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 522/1048] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:27.251756 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0329c-54d7-4e90-9a6f-f03ea4aedc98 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.252362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0329c-54d7-4e90-9a6f-f03ea4aedc98 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.252362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0329c-54d7-4e90-9a6f-f03ea4aedc98 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.253832 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 527/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:27.259526 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5769-fccf-42e0-84a8-59929181c807 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.260087 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5769-fccf-42e0-84a8-59929181c807 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.260263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5769-fccf-42e0-84a8-59929181c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.284308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-82df5769-fccf-42e0-84a8-59929181c807 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:27.285565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-82df5769-fccf-42e0-84a8-59929181c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:27.299537 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 523/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:27.455735 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0329c-54d7-4e90-9a6f-f03ea4aedc98 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:27.477621 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0329c-54d7-4e90-9a6f-f03ea4aedc98 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:27.485679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:27.486306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.486581 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.486847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.496269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:27.498903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6e72-db89-44ec-9c28-7598ca56cdbd service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:27.510040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 528/1051] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:28.337283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995687-789d-4048-8109-ad32420037ce None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:28.337847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995687-789d-4048-8109-ad32420037ce None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:28.337847 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995687-789d-4048-8109-ad32420037ce None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:28.339150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 524/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:28.344606 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1eab4-c02f-492a-a83c-8d46cbd44b8a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:28.345139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1eab4-c02f-492a-a83c-8d46cbd44b8a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:28.345139 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1eab4-c02f-492a-a83c-8d46cbd44b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:28.367495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f6a1eab4-c02f-492a-a83c-8d46cbd44b8a None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:28.368762 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f6a1eab4-c02f-492a-a83c-8d46cbd44b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:28.377111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 529/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:28.542265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995687-789d-4048-8109-ad32420037ce None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:28.562800 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995687-789d-4048-8109-ad32420037ce None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:28.569615 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:28.570226 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:28.570501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:28.570767 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:28.579859 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:28.581491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c1fd2-4f5c-4a52-b517-f0baaf292cad service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:28.591197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 525/1054] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:29.428487 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a00f-7f57-437c-acdd-18571acd9ff7 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:29.429093 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a00f-7f57-437c-acdd-18571acd9ff7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:29.429093 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a00f-7f57-437c-acdd-18571acd9ff7 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:29.430369 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 530/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:29.435589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ed68-0b34-4e29-9ce0-1c6a516b2a33 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:29.436247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ed68-0b34-4e29-9ce0-1c6a516b2a33 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:29.436247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ed68-0b34-4e29-9ce0-1c6a516b2a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:29.466818 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-62e5ed68-0b34-4e29-9ce0-1c6a516b2a33 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:29.468076 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-62e5ed68-0b34-4e29-9ce0-1c6a516b2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:29.477937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 526/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:25:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:29.646336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a00f-7f57-437c-acdd-18571acd9ff7 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:29.666172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a00f-7f57-437c-acdd-18571acd9ff7 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:29.673341 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:29.674126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:29.674270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:29.674530 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:29.684648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:29.686487 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb3845-359f-4043-bf21-bda2405a0401 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:29.697616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 531/1057] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:31.799158 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdeeb5-bcbc-481b-ad8f-4efb4fe0909a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:31.799760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdeeb5-bcbc-481b-ad8f-4efb4fe0909a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:31.799760 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdeeb5-bcbc-481b-ad8f-4efb4fe0909a None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:31.801065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 527/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:31.807775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacca50-22f7-4a55-8b17-cd37543908d5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:31.808553 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacca50-22f7-4a55-8b17-cd37543908d5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:31.808703 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacca50-22f7-4a55-8b17-cd37543908d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:31.836182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9cacca50-22f7-4a55-8b17-cd37543908d5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:31.837434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9cacca50-22f7-4a55-8b17-cd37543908d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:31.847619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 532/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:32.184517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdeeb5-bcbc-481b-ad8f-4efb4fe0909a None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:32.197819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdeeb5-bcbc-481b-ad8f-4efb4fe0909a None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:32.203755 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:32.204726 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:32.205138 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:32.205546 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:32.219834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:32.221303 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc979a-5176-4b16-96ac-3a438565865f service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:32.231208 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 528/1060] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:34.724639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda961b-fb8f-4c5d-a73e-96fdf6beb63b None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:34.725305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda961b-fb8f-4c5d-a73e-96fdf6beb63b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:34.725305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda961b-fb8f-4c5d-a73e-96fdf6beb63b None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:34.727192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 533/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:34.734649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120a56-bf26-467b-8496-90022412fe14 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:34.735197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120a56-bf26-467b-8496-90022412fe14 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:34.735197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120a56-bf26-467b-8496-90022412fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:34.763244 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-95120a56-bf26-467b-8496-90022412fe14 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:34.764501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-95120a56-bf26-467b-8496-90022412fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:34.774164 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 529/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:35.127421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda961b-fb8f-4c5d-a73e-96fdf6beb63b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:35.143516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda961b-fb8f-4c5d-a73e-96fdf6beb63b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:35.147407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:35.148040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:35.148314 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:35.148576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:35.158603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:35.160072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fc564-4e8d-43ee-a4c0-205e909e1e6a service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:35.171786 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 534/1063] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:37.720596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e4a5-8193-43a4-b970-adc223855e81 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:37.721475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e4a5-8193-43a4-b970-adc223855e81 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:37.721475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e4a5-8193-43a4-b970-adc223855e81 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:37.723698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 530/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:37.732166 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58caff-bc0e-442a-921f-2e0729ea1688 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:37.732679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58caff-bc0e-442a-921f-2e0729ea1688 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:37.732679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58caff-bc0e-442a-921f-2e0729ea1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:37.752608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-7d58caff-bc0e-442a-921f-2e0729ea1688 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:37.753813 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-7d58caff-bc0e-442a-921f-2e0729ea1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:37.761824 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 535/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:25:38.099058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e4a5-8193-43a4-b970-adc223855e81 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:38.111489 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e4a5-8193-43a4-b970-adc223855e81 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:38.116380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:38.117005 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:38.117283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:38.117551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:38.129832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:38.131304 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf34f3b-d0be-44b8-bc45-be49ab3e3edf service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:38.142481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 531/1066] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:40.496972 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5188-604d-4596-bfa9-8da6a0ca5c84 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:40.497580 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5188-604d-4596-bfa9-8da6a0ca5c84 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:40.497687 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b5188-604d-4596-bfa9-8da6a0ca5c84 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:40.499169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 536/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:40.505937 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3eba8-2097-4618-a846-b3d6aabf695b None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:40.506390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3eba8-2097-4618-a846-b3d6aabf695b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:40.506480 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3eba8-2097-4618-a846-b3d6aabf695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:40.529294 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-27d3eba8-2097-4618-a846-b3d6aabf695b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:40.530517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-27d3eba8-2097-4618-a846-b3d6aabf695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:40.539092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 532/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:25:40.899888 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b5188-604d-4596-bfa9-8da6a0ca5c84 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:40.913021 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b5188-604d-4596-bfa9-8da6a0ca5c84 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:40.917515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:40.918186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:40.918448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:40.918714 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:40.929765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:40.931268 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61665-bc64-4f71-a230-3e949268a2c1 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:40.942647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 537/1069] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:43.240001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6e920-cf0c-4db8-9ca8-eeb977bff0e3 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:43.240618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6e920-cf0c-4db8-9ca8-eeb977bff0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:43.240618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6e920-cf0c-4db8-9ca8-eeb977bff0e3 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:43.241872 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 533/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:43.248180 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de79a-efb9-4fac-851d-3123ad0544d5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:43.248941 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de79a-efb9-4fac-851d-3123ad0544d5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:43.249041 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510de79a-efb9-4fac-851d-3123ad0544d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:43.278708 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-510de79a-efb9-4fac-851d-3123ad0544d5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:43.280048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-510de79a-efb9-4fac-851d-3123ad0544d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:43.289422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 538/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:43.650917 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6e920-cf0c-4db8-9ca8-eeb977bff0e3 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:43.669723 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6e920-cf0c-4db8-9ca8-eeb977bff0e3 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:43.674577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:43.675174 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:43.675456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:43.675727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:43.685927 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:43.687419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac00bf-4e65-4fa1-b42e-8e2abe1223a6 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:43.697616 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 534/1072] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:45.977700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a064-6cdc-4991-8f15-a1b6ef4c0d69 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:45.978285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a064-6cdc-4991-8f15-a1b6ef4c0d69 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:45.978285 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a064-6cdc-4991-8f15-a1b6ef4c0d69 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:45.979611 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 539/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:45.985764 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871f94-8a27-4e8c-836d-cb04826e0747 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:45.986247 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871f94-8a27-4e8c-836d-cb04826e0747 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:45.986396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871f94-8a27-4e8c-836d-cb04826e0747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:45.993920 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=70 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:46.009213 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-2a871f94-8a27-4e8c-836d-cb04826e0747 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:46.010439 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-2a871f94-8a27-4e8c-836d-cb04826e0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:46.019111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 535/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:46.371047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a064-6cdc-4991-8f15-a1b6ef4c0d69 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:46.378948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=64 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:46.387299 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a064-6cdc-4991-8f15-a1b6ef4c0d69 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:46.392060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:46.392979 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:46.393541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:46.393853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:46.404536 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:46.406158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57ea28-d61d-4a5d-b1dd-93d26d4847af service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:46.416508 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 540/1075] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:48.671671 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c32b-21b3-48a1-9be5-a0687bb09c2b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:48.672345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c32b-21b3-48a1-9be5-a0687bb09c2b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:48.672345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01c32b-21b3-48a1-9be5-a0687bb09c2b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:48.673554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 536/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:48.679032 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6ef-24db-4c1e-a6ca-d67d40ed90a1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:48.679502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6ef-24db-4c1e-a6ca-d67d40ed90a1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:48.679608 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d6ef-24db-4c1e-a6ca-d67d40ed90a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:48.701277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-c067d6ef-24db-4c1e-a6ca-d67d40ed90a1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:48.702541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-c067d6ef-24db-4c1e-a6ca-d67d40ed90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:48.711602 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 541/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:49.056198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c32b-21b3-48a1-9be5-a0687bb09c2b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:49.068799 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01c32b-21b3-48a1-9be5-a0687bb09c2b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:49.073001 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:49.073606 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:49.073880 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:49.074358 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:49.084198 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:49.085629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58620b7c-6698-4c49-ab1d-abdd0dcfd2a2 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:49.095491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 537/1078] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:51.350321 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394a50-b060-4b8c-a5f4-1a64062525ce None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:51.350949 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394a50-b060-4b8c-a5f4-1a64062525ce None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:51.350949 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394a50-b060-4b8c-a5f4-1a64062525ce None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:51.352234 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 542/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:51.358531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb11a-252c-4b6d-aae7-6e632c52a717 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:51.358981 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb11a-252c-4b6d-aae7-6e632c52a717 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:51.359092 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bb11a-252c-4b6d-aae7-6e632c52a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:51.379194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-5b9bb11a-252c-4b6d-aae7-6e632c52a717 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:51.380463 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-5b9bb11a-252c-4b6d-aae7-6e632c52a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:51.388803 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 538/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:25:51.732434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394a50-b060-4b8c-a5f4-1a64062525ce None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:51.744473 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394a50-b060-4b8c-a5f4-1a64062525ce None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:51.749072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:51.749747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:51.750188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:51.750458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:51.760410 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:51.761977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e630e-6e08-4fc6-bb7e-68ecf2bf5641 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:51.772042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 543/1081] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:54.015363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec630317-192b-4347-97dc-2f4ab64239c2 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:54.016023 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec630317-192b-4347-97dc-2f4ab64239c2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:54.016023 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec630317-192b-4347-97dc-2f4ab64239c2 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:54.017281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 539/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:25:54.023238 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b825b-b550-4db0-a66f-9182e8260a48 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:54.023744 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b825b-b550-4db0-a66f-9182e8260a48 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:54.023845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b825b-b550-4db0-a66f-9182e8260a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:54.043700 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-073b825b-b550-4db0-a66f-9182e8260a48 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:54.045036 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-073b825b-b550-4db0-a66f-9182e8260a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:54.054126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 544/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:54.401662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec630317-192b-4347-97dc-2f4ab64239c2 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:54.413371 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec630317-192b-4347-97dc-2f4ab64239c2 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:54.417218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:54.418186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:54.418186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:54.418467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:54.427957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:54.429442 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628a308-216f-4253-908c-f459bc02291b service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:54.440656 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 540/1084] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:56.728904 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc62-2653-493b-9efd-4c6efde790dd None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:56.729597 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc62-2653-493b-9efd-4c6efde790dd None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:56.729597 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc62-2653-493b-9efd-4c6efde790dd None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:56.730959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 545/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:25:56.738615 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a7ea-fd74-4ef0-a96c-85ccf7dd8cc1 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:56.739179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a7ea-fd74-4ef0-a96c-85ccf7dd8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:56.739179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a7ea-fd74-4ef0-a96c-85ccf7dd8cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:56.762084 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-2bb5a7ea-fd74-4ef0-a96c-85ccf7dd8cc1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:56.763453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-2bb5a7ea-fd74-4ef0-a96c-85ccf7dd8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:56.772456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 541/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:57.115362 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325dc62-2653-493b-9efd-4c6efde790dd None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:57.132060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325dc62-2653-493b-9efd-4c6efde790dd None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:57.136930 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:57.137526 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:57.137797 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:57.138062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:57.148125 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:57.149555 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb33fb-cfd5-44fe-881f-083b83d3aa5a service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:57.160395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 546/1087] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:06.755998 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=20 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:07.155496 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=23 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:21.654148 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bad49-81f7-41f8-ab41-fa38a6ed2fce None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:21.654804 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bad49-81f7-41f8-ab41-fa38a6ed2fce None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:21.654804 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bad49-81f7-41f8-ab41-fa38a6ed2fce None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:21.656116 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 542/1088] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:21.663022 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf97-5a9f-4702-8afd-db1eeef580ea None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:21.663576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf97-5a9f-4702-8afd-db1eeef580ea None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:21.663576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bf97-5a9f-4702-8afd-db1eeef580ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:21.684497 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-8fc1bf97-5a9f-4702-8afd-db1eeef580ea None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:21.685723 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-8fc1bf97-5a9f-4702-8afd-db1eeef580ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:21.700462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 547/1089] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:22.059315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6021-a9d6-4f69-9930-c9f73451e97b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:22.059601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6021-a9d6-4f69-9930-c9f73451e97b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:22.059904 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b6021-a9d6-4f69-9930-c9f73451e97b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:22.061321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 543/1090] 10.222.0.75 () {54 vars in 967 bytes} [Tue Aug 23 23:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:22.067521 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d16a-8470-475a-80fb-a86c6314c04a None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:22.067810 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d16a-8470-475a-80fb-a86c6314c04a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:22.068097 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d16a-8470-475a-80fb-a86c6314c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:22.088961 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-7560d16a-8470-475a-80fb-a86c6314c04a None None] MFA Rules not processed for user `84548f065a0240e2b700b2c9eecb8bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:22.090195 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-7560d16a-8470-475a-80fb-a86c6314c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:22.097607 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 548/1091] 10.222.0.75 () {58 vars in 1064 bytes} [Tue Aug 23 23:26:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:22.105613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b6021-a9d6-4f69-9930-c9f73451e97b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:22.117196 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b6021-a9d6-4f69-9930-c9f73451e97b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:22.121257 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84548f065a0240e2b700b2c9eecb8bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:22.121870 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:22.122141 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:22.122410 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:22.131749 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:22.133212 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620972-136b-4930-a345-f6cc7149bb94 service glance] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:22.143009 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 544/1092] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:24.575326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397758-2c05-4bc6-9621-68074723b221 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:24.575921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397758-2c05-4bc6-9621-68074723b221 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:24.575921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397758-2c05-4bc6-9621-68074723b221 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:24.577216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 549/1093] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:24.583788 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc67b7-ce78-4fff-87a8-ee49c997c2ed None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:24.584283 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc67b7-ce78-4fff-87a8-ee49c997c2ed None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:24.584383 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc67b7-ce78-4fff-87a8-ee49c997c2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:24.605192 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-8ffc67b7-ce78-4fff-87a8-ee49c997c2ed None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:24.606408 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-8ffc67b7-ce78-4fff-87a8-ee49c997c2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:24.614697 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 545/1094] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:24.943535 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397758-2c05-4bc6-9621-68074723b221 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:24.957676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397758-2c05-4bc6-9621-68074723b221 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:24.962814 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:24.964009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:24.964296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:24.964574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:24.965236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:24.967066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:24.967066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:26:24.967066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:26:24.968914 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b859c8f-fb5b-4f97-a58b-ac5aad905acb admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:24.988483 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 550/1095] 10.222.0.75 () {56 vars in 1108 bytes} [Tue Aug 23 23:26:24 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:26:27.222351 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84c11-89d0-4087-901a-06cf6fde8e1f None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:27.223269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84c11-89d0-4087-901a-06cf6fde8e1f None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:27.223269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84c11-89d0-4087-901a-06cf6fde8e1f None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:27.224427 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 546/1096] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:26:27.230755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3c47-7a0e-4cbc-9eb8-7cf728c47aa2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:27.231303 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3c47-7a0e-4cbc-9eb8-7cf728c47aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:27.231303 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f3c47-7a0e-4cbc-9eb8-7cf728c47aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:27.252001 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-273f3c47-7a0e-4cbc-9eb8-7cf728c47aa2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:27.253200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-273f3c47-7a0e-4cbc-9eb8-7cf728c47aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:27.262163 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 551/1097] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:27.616622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84c11-89d0-4087-901a-06cf6fde8e1f None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:27.636085 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84c11-89d0-4087-901a-06cf6fde8e1f None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:27.643449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:27.644347 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:27.644744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:27.645022 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:27.657036 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:27.659150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e25c3d-a508-46a5-a737-da8872c1f45b service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:27.673260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 547/1098] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:30.135695 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125756-19a7-46b4-ac74-e9401fbdd16f None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:30.136306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125756-19a7-46b4-ac74-e9401fbdd16f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:30.136306 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55125756-19a7-46b4-ac74-e9401fbdd16f None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:30.138853 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 552/1099] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:30.147161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691f9e4-ef08-4758-9831-ac7d5dfb1f57 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:30.147652 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691f9e4-ef08-4758-9831-ac7d5dfb1f57 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:30.147762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691f9e4-ef08-4758-9831-ac7d5dfb1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:30.170035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-b691f9e4-ef08-4758-9831-ac7d5dfb1f57 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:30.171540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-b691f9e4-ef08-4758-9831-ac7d5dfb1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:30.179562 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 548/1100] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:30.536385 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125756-19a7-46b4-ac74-e9401fbdd16f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:30.549294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55125756-19a7-46b4-ac74-e9401fbdd16f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:30.553208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:30.553816 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:30.554093 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:30.554352 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:30.568626 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:30.571169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3ed04-7a0f-4de9-a83b-fef4333d0744 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:30.582354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 553/1101] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:32.874603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cc56-90ee-49fe-a77b-e881751284af None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:32.875277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cc56-90ee-49fe-a77b-e881751284af None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:32.875467 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cc56-90ee-49fe-a77b-e881751284af None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:32.877830 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 549/1102] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:32.884517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1497-4a91-40ed-9321-890acf437b2b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:32.885208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1497-4a91-40ed-9321-890acf437b2b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:32.885421 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec1497-4a91-40ed-9321-890acf437b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:32.907134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-41ec1497-4a91-40ed-9321-890acf437b2b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:32.908378 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-41ec1497-4a91-40ed-9321-890acf437b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:32.920111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 554/1103] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:33.270248 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cc56-90ee-49fe-a77b-e881751284af None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:33.282372 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cc56-90ee-49fe-a77b-e881751284af None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:33.286059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:33.286679 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:33.286958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:33.287227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:33.297651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:33.299119 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c90f-ef1d-4ce1-bda2-18f51ce569f7 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:33.309614 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 550/1104] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:35.914066 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd31c-f9df-43d4-b716-87611fa2fb2a None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:35.914959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd31c-f9df-43d4-b716-87611fa2fb2a None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:35.914959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fd31c-f9df-43d4-b716-87611fa2fb2a None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:35.916140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 555/1105] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:35.922555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2558e2-3608-40a2-b09c-c561e4107cb1 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:35.924402 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2558e2-3608-40a2-b09c-c561e4107cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:35.924402 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2558e2-3608-40a2-b09c-c561e4107cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:35.955506 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-1a2558e2-3608-40a2-b09c-c561e4107cb1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:35.956827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-1a2558e2-3608-40a2-b09c-c561e4107cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:35.966056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 551/1106] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:36.346513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fd31c-f9df-43d4-b716-87611fa2fb2a None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:36.359006 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fd31c-f9df-43d4-b716-87611fa2fb2a None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:36.368413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:36.368968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:36.369667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:36.369667 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:36.379731 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:36.381236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce88c7-d37d-4317-8a5d-3eda48b4dc59 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:36.392420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 556/1107] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:39.349365 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902832-f719-4bb9-bcc5-48727a595bcd None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.350046 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902832-f719-4bb9-bcc5-48727a595bcd None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.350046 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94902832-f719-4bb9-bcc5-48727a595bcd None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.351275 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 552/1108] 10.222.0.75 () {54 vars in 927 bytes} [Tue Aug 23 23:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:39.357646 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a56c8-9d3c-4d40-855c-7a91b5f347b0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.358208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a56c8-9d3c-4d40-855c-7a91b5f347b0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.358208 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a56c8-9d3c-4d40-855c-7a91b5f347b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.378305 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f83a56c8-9d3c-4d40-855c-7a91b5f347b0 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:39.379531 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f83a56c8-9d3c-4d40-855c-7a91b5f347b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:39.388215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 557/1109] 10.222.0.75 () {58 vars in 1024 bytes} [Tue Aug 23 23:26:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:39.747811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902832-f719-4bb9-bcc5-48727a595bcd None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:39.763189 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94902832-f719-4bb9-bcc5-48727a595bcd None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:39.769388 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:39.770047 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.770322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.770590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.781255 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:39.782743 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5aae6-7e2b-4de2-b62f-5b0cdb320e9f service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:39.793748 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 553/1110] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:49.373308 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=33 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:49.788869 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=33 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:58.755909 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:58.756790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:58.756790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:58.851088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:27:58.853054 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:58.927144 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 558/1111] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:27:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:27:58.936776 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:58.937503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:58.937503 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:58.967368 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:27:58.969268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:58.981649 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 554/1112] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:27:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:27:58.987168 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:58.999557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ac0d7-f151-4d6a-8a98-dd67866c9180 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.006966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.007767 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.008182 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.008382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.009384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:27:59.009796 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.011386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.011386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:27:59.011386 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:27:59.012664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.029539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 559/1113] 10.222.0.75 () {58 vars in 1153 bytes} [Tue Aug 23 23:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:27:59.038355 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.050940 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271a63-18d6-4555-864c-2428f38be8b3 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.056341 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.057088 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.057360 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.057624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.058254 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.060398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.060398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:27:59.060398 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:27:59.061607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.103821 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 555/1114] 10.222.0.75 () {60 vars in 1153 bytes} [Tue Aug 23 23:27:59 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:27:59.108685 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.122296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8ac3-56f0-4e21-ae35-75244d86625d admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.191502 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.192143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.192414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.192707 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.193336 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.194422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.194422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:27:59.194422 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:27:59.195660 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.221819 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 560/1115] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:27:59 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:27:59.226158 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.237529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e936ed8-884e-41a6-a704-113f9650fe91 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.244246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.244864 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.245140 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.245407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.246057 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.247089 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.247089 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:27:59.247089 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:27:59.248029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.263355 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 556/1116] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:27:59.267827 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.281446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c04f-a8e2-4fdb-bcad-21672c35f408 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.289072 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.289690 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.289967 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.290233 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.290890 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.291948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.291948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:27:59.291948 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:27:59.292858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa11441-afdd-4369-8087-2c42d7459ccf admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.310629 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 561/1117] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:27:59.316010 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.327308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8341-e606-405a-bb0a-3dc2435bbfcd admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.332911 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.333662 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.333908 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.334183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] PATH_INFO: `/v3/projects/4c14370503e0416bb494dcce19f2b902/users/7394f615e83e4767b9c7588343082ffc/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.350918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c14370503e0416bb494dcce19f2b902, user_id=7394f615e83e4767b9c7588343082ffc, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.352060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.352060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:27:59.352060 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:27:59.354017 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824b5b-8339-432a-b164-fb0a9a668d9d admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.368683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 557/1118] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:27:59 2022] PUT /identity/v3/projects/4c14370503e0416bb494dcce19f2b902/users/7394f615e83e4767b9c7588343082ffc/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:27:59.381654 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cccbc1-de32-40d3-8b65-3dce2b16fea1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.381960 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cccbc1-de32-40d3-8b65-3dce2b16fea1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.382236 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cccbc1-de32-40d3-8b65-3dce2b16fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.415560 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-76cccbc1-de32-40d3-8b65-3dce2b16fea1 None None] MFA Rules not processed for user `7394f615e83e4767b9c7588343082ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:27:59.416828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-76cccbc1-de32-40d3-8b65-3dce2b16fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:59.455717 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:59.498957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 562/1119] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:27:59 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:27:59.515676 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3a70-0590-4d29-9823-2fd93563ff0e None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.515958 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3a70-0590-4d29-9823-2fd93563ff0e None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.516274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3a70-0590-4d29-9823-2fd93563ff0e None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.517490 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 558/1120] 10.222.0.75 () {54 vars in 964 bytes} [Tue Aug 23 23:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:27:59.524126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d32-2e3f-45a2-925f-9a9df7ee829b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.524480 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d32-2e3f-45a2-925f-9a9df7ee829b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.524800 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919d32-2e3f-45a2-925f-9a9df7ee829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.563318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ef919d32-2e3f-45a2-925f-9a9df7ee829b None None] MFA Rules not processed for user `a4243bac39ca441498a5fc88927c6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:27:59.564572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ef919d32-2e3f-45a2-925f-9a9df7ee829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:59.649381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 563/1121] 10.222.0.75 () {58 vars in 1061 bytes} [Tue Aug 23 23:27:59 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:27:59.658272 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3a70-0590-4d29-9823-2fd93563ff0e None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.673308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3a70-0590-4d29-9823-2fd93563ff0e None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.678952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4243bac39ca441498a5fc88927c6dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.679629 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.679906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.680199 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.689556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.691037 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.700955 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 559/1122] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:27:59 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:27:59.750549 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a13c-97f5-4939-9ff9-55c31ce6b258 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.750826 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a13c-97f5-4939-9ff9-55c31ce6b258 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.751105 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950a13c-97f5-4939-9ff9-55c31ce6b258 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.752467 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 564/1123] 10.222.0.75 () {52 vars in 830 bytes} [Tue Aug 23 23:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:27:59.756784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:59.830860 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a579-5680-43e1-bccd-f42f3f7cfeca service cinder] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:59.836348 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:59.837015 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:59.837284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:59.837544 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] PATH_INFO: `/v3/users/7394f615e83e4767b9c7588343082ffc` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:59.838798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7394f615e83e4767b9c7588343082ffc)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:59.839918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:27:59.839918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:27:59.839918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:27:59.841108 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:59.926419 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7394f615e83e4767b9c7588343082ffc'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:27:59.945050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7394f615e83e4767b9c7588343082ffc'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:27:59.982260 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7394f615e83e4767b9c7588343082ffc'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:27:59.987819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:59.995647 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7394f615e83e4767b9c7588343082ffc'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:27:59.996468 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7394f615e83e4767b9c7588343082ffc'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.003549 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 560/1124] 10.222.0.75 () {58 vars in 1224 bytes} [Tue Aug 23 23:27:59 2022] DELETE /identity/v3/users/7394f615e83e4767b9c7588343082ffc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:28:00.008594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:00.009186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:00.009186 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:00.030785 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:00.032117 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:00.106570 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 565/1125] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:28:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:00.118407 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:00.120682 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:00.195532 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229f28-656f-44e1-9102-ddb2bdd0b518 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:00.200573 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:00.201242 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:00.201516 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:00.201957 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:00.216122 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:00.219059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438b888-74fb-450f-9e6c-4379e3bd6737 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:00.231900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 561/1126] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:28:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:00.664579 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:00.666065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:00.680559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14a551-326c-4ff0-ba12-ee3eb9b0f88f None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:00.687699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:00.688670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:00.689058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:00.689425 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] PATH_INFO: `/v3/projects/4c14370503e0416bb494dcce19f2b902` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:00.690797 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c14370503e0416bb494dcce19f2b902)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:00.693062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:28:00.693062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:28:00.693062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:28:00.694717 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:00.785927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c14370503e0416bb494dcce19f2b902', 'request_id': 'req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.794253 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:00.798957 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c14370503e0416bb494dcce19f2b902', 'request_id': 'req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.819495 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c14370503e0416bb494dcce19f2b902', 'request_id': 'req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.833414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] The token cache is being invalidate because project 4c14370503e0416bb494dcce19f2b902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:28:00.833738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.834441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-e6872d6d-2dd0-4af0-8ae1-2cf4985fae2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:28:00.837248 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 566/1127] 10.222.0.75 () {58 vars in 1233 bytes} [Tue Aug 23 23:28:00 2022] DELETE /identity/v3/projects/4c14370503e0416bb494dcce19f2b902 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:28:10.226159 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:10.829620 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:28.111222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:28.111916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:28.111916 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:28.113112 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 562/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:28.118794 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385179a-aced-4a6c-ac23-facbe666a2a1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:28.119671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385179a-aced-4a6c-ac23-facbe666a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:28.119671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385179a-aced-4a6c-ac23-facbe666a2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:28.141384 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-0385179a-aced-4a6c-ac23-facbe666a2a1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:28.142617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-0385179a-aced-4a6c-ac23-facbe666a2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:28.209414 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 567/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:29:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:29:28.384834 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:28.387065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:28.478642 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b78ac-5744-48cf-928d-5934bab90faf None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:28.485897 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:28.486646 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:28.487018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:28.487382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:28.498528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:28.501188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e17f7-0747-496d-b94a-07eddf516928 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:28.517141 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 563/1130] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:29.429578 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed12df-ef12-436a-95d8-9866f8aa5420 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:29.430215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed12df-ef12-436a-95d8-9866f8aa5420 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:29.430215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed12df-ef12-436a-95d8-9866f8aa5420 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:29.432754 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 568/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:29.438823 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a928-f882-48ec-a6cb-b34e7c21e3c6 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:29.439448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a928-f882-48ec-a6cb-b34e7c21e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:29.439448 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a928-f882-48ec-a6cb-b34e7c21e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:29.473078 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-75f8a928-f882-48ec-a6cb-b34e7c21e3c6 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:29.475023 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-75f8a928-f882-48ec-a6cb-b34e7c21e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:29.484067 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 564/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:29:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:29.664060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed12df-ef12-436a-95d8-9866f8aa5420 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:29.682660 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed12df-ef12-436a-95d8-9866f8aa5420 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:29.688061 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:29.688678 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:29.688956 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:29.689923 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:29.699156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:29.700809 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e66cee-e551-43ea-bf27-fa0809036dfe service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:29.712404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 569/1133] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:35.535438 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7d84-1b2f-4199-898b-5caaba625b1a None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:35.536308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7d84-1b2f-4199-898b-5caaba625b1a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:35.536308 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7d84-1b2f-4199-898b-5caaba625b1a None None] PATH_INFO: `/v3` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:35.537580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 565/1134] 10.222.0.58 () {54 vars in 925 bytes} [Tue Aug 23 23:29:35 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:29:35.546107 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c2b-fa0e-47b6-bb68-72c10e680ad0 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:35.546715 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c2b-fa0e-47b6-bb68-72c10e680ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:35.546858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c2b-fa0e-47b6-bb68-72c10e680ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:35.572060 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-85156c2b-fa0e-47b6-bb68-72c10e680ad0 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:35.573329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-85156c2b-fa0e-47b6-bb68-72c10e680ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:35.650821 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 570/1135] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 23 23:29:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:39.463208 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=35 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:40.087659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ebba-382e-4bad-9526-15b228b8fa07 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:40.087971 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ebba-382e-4bad-9526-15b228b8fa07 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:40.088390 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ebba-382e-4bad-9526-15b228b8fa07 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:40.089627 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 566/1136] 10.222.0.75 () {54 vars in 961 bytes} [Tue Aug 23 23:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:29:40.095275 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2d9b-8768-4e8c-889f-da953110d8f1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:40.095774 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2d9b-8768-4e8c-889f-da953110d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:40.095927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2d9b-8768-4e8c-889f-da953110d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:40.116544 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-74ea2d9b-8768-4e8c-889f-da953110d8f1 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:40.117755 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-74ea2d9b-8768-4e8c-889f-da953110d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:40.127326 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 571/1137] 10.222.0.75 () {58 vars in 1058 bytes} [Tue Aug 23 23:29:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:40.134974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0ebba-382e-4bad-9526-15b228b8fa07 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:40.151168 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0ebba-382e-4bad-9526-15b228b8fa07 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:40.157493 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:40.158114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:40.158386 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:40.158657 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:40.168580 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:40.170184 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1acd1-2bfa-4a9f-bb30-5a83ba01e1f8 service placement] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:40.181157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 567/1138] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:40.990154 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b807-7578-4370-9430-3bd05a04b00c None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:40.990458 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b807-7578-4370-9430-3bd05a04b00c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:40.990728 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b807-7578-4370-9430-3bd05a04b00c None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:40.992142 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:40.997393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e073a-b850-4c8b-a0dc-ca04e6461c75 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:40.997896 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e073a-b850-4c8b-a0dc-ca04e6461c75 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:40.998044 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e073a-b850-4c8b-a0dc-ca04e6461c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:41.020842 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-750e073a-b850-4c8b-a0dc-ca04e6461c75 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:41.022121 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-750e073a-b850-4c8b-a0dc-ca04e6461c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:41.031505 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:29:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:41.198491 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b807-7578-4370-9430-3bd05a04b00c None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:41.212964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b807-7578-4370-9430-3bd05a04b00c None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:41.218375 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:41.218970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:41.219247 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:41.219498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:41.231454 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:41.233269 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55745b14-073a-41ac-be59-a0abf44afcd7 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:41.245313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 573/1141] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:29:42.122511 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e7cb-4a7e-4af9-80fa-8556f3d766d2 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:42.123423 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e7cb-4a7e-4af9-80fa-8556f3d766d2 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:42.123867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e7cb-4a7e-4af9-80fa-8556f3d766d2 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:42.126305 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:29:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:29:42.134685 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec3c4-fc25-49be-9566-68d600b1bed5 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:42.135158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec3c4-fc25-49be-9566-68d600b1bed5 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:42.135650 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec3c4-fc25-49be-9566-68d600b1bed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:42.166282 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-803ec3c4-fc25-49be-9566-68d600b1bed5 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:42.167568 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-803ec3c4-fc25-49be-9566-68d600b1bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:42.180196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:29:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:42.370858 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5e7cb-4a7e-4af9-80fa-8556f3d766d2 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:42.397528 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5e7cb-4a7e-4af9-80fa-8556f3d766d2 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:42.408734 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:42.409349 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:42.409621 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:42.409915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:42.420003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:42.421816 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c956-bb38-443c-9769-a6dcd563bdb1 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:42.433057 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 570/1144] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:46.569070 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:46.569593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:46.569593 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:46.570903 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:46.576514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f136-37a6-4a4d-91c4-839ef3c18434 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:46.576974 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f136-37a6-4a4d-91c4-839ef3c18434 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:46.577177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f136-37a6-4a4d-91c4-839ef3c18434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:46.597432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-12e4f136-37a6-4a4d-91c4-839ef3c18434 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:46.598661 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-12e4f136-37a6-4a4d-91c4-839ef3c18434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:46.607194 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:29:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:29:46.982666 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:46.985135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:47.055603 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:47.063777 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde42fff-b7a1-480f-afa6-898cbeac7d3e None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:47.068955 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:47.069748 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:47.070159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:47.070559 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:47.083583 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:47.085437 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df50192-95f1-495a-8fd5-23aa2507ed93 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:47.099476 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 576/1147] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:49.322737 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:49.323466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:49.323466 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:49.325393 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:29:49.330879 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4cc5-e4f9-444f-b337-ffbe2c5a2031 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:49.331356 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4cc5-e4f9-444f-b337-ffbe2c5a2031 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:49.331460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4cc5-e4f9-444f-b337-ffbe2c5a2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:49.352897 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-23bd4cc5-e4f9-444f-b337-ffbe2c5a2031 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:49.354100 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-23bd4cc5-e4f9-444f-b337-ffbe2c5a2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:49.363286 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:29:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:49.737280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:49.739379 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:49.754391 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d106b-2ad5-4e7c-aeff-39f94fcff131 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:49.760165 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:49.760994 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:49.761378 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:49.761762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:49.774755 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:49.777727 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d67bb-023c-4107-916a-ebf3882ca77a service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:49.791278 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 573/1150] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:53.693382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79013ee0-793e-4670-a968-68eab0844443 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:53.694055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79013ee0-793e-4670-a968-68eab0844443 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:53.694055 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79013ee0-793e-4670-a968-68eab0844443 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:53.695990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:29:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:53.704876 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e002-6461-4dea-a625-94991c35377b None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:53.705895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e002-6461-4dea-a625-94991c35377b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:53.705895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e002-6461-4dea-a625-94991c35377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:53.733647 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-d654e002-6461-4dea-a625-94991c35377b None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:53.735152 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-d654e002-6461-4dea-a625-94991c35377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:53.745296 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:29:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:54.327259 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79013ee0-793e-4670-a968-68eab0844443 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:54.329297 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-79013ee0-793e-4670-a968-68eab0844443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:54.405177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79013ee0-793e-4670-a968-68eab0844443 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:54.409562 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4243bac39ca441498a5fc88927c6dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:54.410172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:54.410446 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:54.410705 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:54.421224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:54.422752 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991083f-1899-41bb-83ce-df914cd7ad19 service cinder] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:54.433037 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 579/1153] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:56.752166 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:56.753065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:56.753065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:56.755090 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:29:56.764404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f7e5-a225-43c2-a24f-89ad8750817c None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:56.766403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f7e5-a225-43c2-a24f-89ad8750817c None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:56.766403 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f7e5-a225-43c2-a24f-89ad8750817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:56.787115 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-8ff5f7e5-a225-43c2-a24f-89ad8750817c None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:56.789260 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-8ff5f7e5-a225-43c2-a24f-89ad8750817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:56.798270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:29:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:57.384752 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:57.386893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:57.402477 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb5ba-f173-481c-86d0-e5f9789911f4 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:57.407157 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4243bac39ca441498a5fc88927c6dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:57.407758 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:57.408048 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:57.408320 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:57.418155 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:57.419607 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3ac4-fdf9-47ca-851a-bea866ea4a9d service cinder] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:57.429735 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 576/1156] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:06.782143 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=42 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:07.425430 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=33 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:15.896178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50260bb-ffaa-4c35-bf87-ea3dc5ec0d32 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:15.897148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50260bb-ffaa-4c35-bf87-ea3dc5ec0d32 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:15.897148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50260bb-ffaa-4c35-bf87-ea3dc5ec0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:15.924783 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-d50260bb-ffaa-4c35-bf87-ea3dc5ec0d32 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:15.926028 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-d50260bb-ffaa-4c35-bf87-ea3dc5ec0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:15.930899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075233-39c9-469c-a137-54d8191669c4 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:15.931501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075233-39c9-469c-a137-54d8191669c4 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:15.931501 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075233-39c9-469c-a137-54d8191669c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:15.938528 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 581/1157] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:15.947448 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:15.947753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:15.948065 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:15.952704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-25075233-39c9-469c-a137-54d8191669c4 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:15.953934 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-25075233-39c9-469c-a137-54d8191669c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:15.962886 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 577/1158] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:15.971164 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:15.971832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:15.972262 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:15.972392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:15.972571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:15.982873 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 582/1159] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:15.987676 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:15.996088 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:15.997343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:15.998192 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36847d57-a191-4a65-a6cd-3048f90a6ef2 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.006673 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 578/1160] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:16.007670 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.008347 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.008771 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.009053 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] PATH_INFO: `/v3/domains` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.009895 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:31:16.010329 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.012592 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.012827 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.022848 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b574a7d-8230-4d43-b414-093716859f89 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.037964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 583/1161] 10.222.0.75 () {58 vars in 1153 bytes} [Tue Aug 23 23:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:31:16.038290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.038290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.038290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.038290 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:31:16.038921 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.040075 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.049322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 579/1162] 10.222.0.75 () {58 vars in 1153 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:31:16.054920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034958ff-283e-4bd8-a4a9-56e5465a2deb admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.058356 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.059780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.060432 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.060718 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.060990 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.061627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.062651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:31:16.062651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:31:16.062651 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:31:16.064003 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.068534 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e770f-f46f-45bd-a887-83ecaa7b8d08 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.074334 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.074944 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.075261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.075529 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.076195 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.078321 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.101167 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 584/1163] 10.222.0.75 () {60 vars in 1153 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:31:16.101662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.121902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 580/1164] 10.222.0.75 () {60 vars in 1153 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:16.124895 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.191350 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee1eb-2975-47f1-b82d-bec0ce85e0be admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.197781 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.197996 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f34d0-8df4-4247-9ed5-8b4f2ef107b5 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.198405 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.198671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.198939 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.199576 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.201627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.203638 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.204065 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.204337 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.204603 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.205228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.206243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:31:16.206243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:31:16.206243 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:31:16.207445 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.227103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 585/1165] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:16.231662 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.232179 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 581/1166] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:16.236380 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.242092 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53137df2-cc81-4a5c-a3ab-20c9619fb976 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.246412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba775ac-b39e-4b4f-97e9-e9297321b2b9 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.247242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.247861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.248188 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.248517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.249174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.250828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.251620 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.252261 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.252543 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.252810 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.253459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.255207 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.262855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 586/1167] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:31:16.267005 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.270143 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 582/1168] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:31:16.271303 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.278215 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4973ea-b13c-48a7-b41a-6d26a6083dc8 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.281942 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abd9d-e51b-41cd-9a95-eac9fe3ea79f admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.285963 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.286587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.286865 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.287177 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.287768 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.287920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.288811 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.289090 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.289363 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.289729 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.290012 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.292643 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.300619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 587/1169] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:31:16.304403 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 583/1170] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:31:16.305693 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.308502 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.315830 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62ea65-03fb-4f15-b0f3-59e82baead32 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.318556 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f877-db2f-4f1e-825b-6be36a9447ad admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.320791 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.321460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.321844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.322106 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] PATH_INFO: `/v3/projects/4177193808b246afa915d83458b9780c/users/cd0c7eb94921423293b16bf7c528b997/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.324574 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.325297 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.325582 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.325851 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] PATH_INFO: `/v3/projects/a3fd677093e744ec8172b32ac863696c/users/48d7d40763a04b56bddfb0e576ce0df0/roles/2cb849773c2647be9ff33d4efbb48203` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.339594 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4177193808b246afa915d83458b9780c, user_id=cd0c7eb94921423293b16bf7c528b997, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.340995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:31:16.340995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:31:16.340995 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:31:16.343250 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b5d4-e6bf-4307-854a-782f86a619ee admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.343396 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fd677093e744ec8172b32ac863696c, user_id=48d7d40763a04b56bddfb0e576ce0df0, role_id=2cb849773c2647be9ff33d4efbb48203)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.346014 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b990dc-fa6c-4df7-b491-5dc74f74a0e0 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.357207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 588/1171] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:16 2022] PUT /identity/v3/projects/4177193808b246afa915d83458b9780c/users/cd0c7eb94921423293b16bf7c528b997/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:31:16.361183 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 584/1172] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:16 2022] PUT /identity/v3/projects/a3fd677093e744ec8172b32ac863696c/users/48d7d40763a04b56bddfb0e576ce0df0/roles/2cb849773c2647be9ff33d4efbb48203 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:31:16.362591 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.362881 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.363159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.365967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.366251 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.366585 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.382258 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:16.383541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:16.386796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] MFA Rules not processed for user `3f7bbb00e65c4b7393cbc41f848a6216`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:16.388020 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:16.436295 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:16.443264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:16.449991 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 589/1173] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:16.457141 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 585/1174] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:16.461395 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.468265 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:16.521203 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ccac-7e2f-4607-9b26-ce91ceeeae53 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.523340 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42670-97e1-41c2-ba12-510761082af1 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:16.525211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.525834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.526176 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.526488 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.527161 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:16.527732 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:16.528049 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:16.528322 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:16.540268 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.542103 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:16.542962 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50caed6-2f90-41d1-9e5b-88ada361b801 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.544840 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca4c8-c772-41b6-8b65-db525b562211 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:16.559613 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 586/1175] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:16.560243 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 590/1176] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:22.682994 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:22.684083 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:22.684522 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:22.743553 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:22.745374 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:22.767522 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:22.768076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:22.768076 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:22.824601 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] MFA Rules not processed for user `cd0c7eb94921423293b16bf7c528b997`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:22.826968 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:22.881668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 587/1177] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:22.883345 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:22.900040 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5772-d7ff-4fa3-b1c5-0dc6678e013b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:22.906716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:22.908163 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:22.908601 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:22.909029 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] PATH_INFO: `/v3/projects` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:22.910483 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:22.913846 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:22.918249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 591/1178] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:22.919408 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:22.932855 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b5d4-1e72-454c-b606-cf841dc6bdc7 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:22.939765 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:22.940439 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:22.940721 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:22.940986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:22.941628 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:22.944252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:22.963854 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 588/1179] 10.222.0.75 () {60 vars in 1153 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:22.968583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:22.993006 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 592/1180] 10.222.0.75 () {60 vars in 1153 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:22.994086 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.057899 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9722f3-43dd-4401-9d38-ee13e8927348 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.071659 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193d323-4bd8-4e6a-8de4-271e97450a51 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.072461 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:23.080216 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.081334 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.081798 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.081977 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.082665 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.084648 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.104132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:23.125939 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 593/1181] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:23.126927 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.141878 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71080acb-e8a7-4353-ba13-73cb305d6fa4 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.151457 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.152080 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.152244 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.152492 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.152828 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.152952 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.153246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.153623 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] PATH_INFO: `/v3/users` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.153733 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.154762 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.155441 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.157004 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.174389 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 594/1182] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:31:23.180088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.193363 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd36f-ddf6-4c35-a9ff-36a91071a662 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.197234 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 589/1183] 10.222.0.75 () {60 vars in 1144 bytes} [Tue Aug 23 23:31:22 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:31:23.198276 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.199211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.200102 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.200443 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.200778 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] PATH_INFO: `/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6/users/1b2af050b82a486f8792bafb8ae392be/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.212688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61fe82-122f-4f1e-860d-e33352dd1b34 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.218228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.219253 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.220014 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.220520 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.221426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.224434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.229582 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccb40be6d3442cd8209d85e37f8d9d6, user_id=1b2af050b82a486f8792bafb8ae392be, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.232672 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.244281 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 590/1184] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:31:23.249056 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.263581 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 595/1185] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:23 2022] PUT /identity/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6/users/1b2af050b82a486f8792bafb8ae392be/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:31:23.267541 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.270508 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4397cf-f463-4d0c-9446-440905e1c0e3 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.352115 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.353150 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.353440 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.353716 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] PATH_INFO: `/v3/projects/50cf08191acd4781804ff0d457e25a06/users/0e4538297c1943d8b3aa90d646823200/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.375638 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf08191acd4781804ff0d457e25a06, user_id=0e4538297c1943d8b3aa90d646823200, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.385123 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.430292 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5dba-7c1d-4b49-91bf-20731f439900 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.431540 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 591/1186] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:23 2022] PUT /identity/v3/projects/50cf08191acd4781804ff0d457e25a06/users/0e4538297c1943d8b3aa90d646823200/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:31:23.436162 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.521802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.522699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.523345 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.524220 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] PATH_INFO: `/v3/roles` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.525135 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.527571 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.549154 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6705-aaa8-4a07-8a8a-73b8621c860b admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.551271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 596/1187] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:31:23.555798 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.556265 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.556918 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.557343 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.557771 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] PATH_INFO: `/v3/roles` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.558564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.563014 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.570277 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981cb0-df45-4885-90ce-d6f60b83c4df admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.578241 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.579490 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] REQUEST_METHOD: `PUT` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.580085 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.580263 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] PATH_INFO: `/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6/users/1b2af050b82a486f8792bafb8ae392be/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.583658 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccb40be6d3442cd8209d85e37f8d9d6, user_id=1b2af050b82a486f8792bafb8ae392be, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.584518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 592/1188] 10.222.0.75 () {58 vars in 1122 bytes} [Tue Aug 23 23:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:31:23.585421 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:23.587368 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35e2c-5d89-40d9-920c-f94f54b3870b admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.596370 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde13f5-8009-4bd9-9258-bb876afe8eae admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:23.602235 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 597/1189] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:23 2022] PUT /identity/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6/users/1b2af050b82a486f8792bafb8ae392be/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:31:23.610705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:23.671107 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:23.672222 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:23.672595 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:23.673075 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] PATH_INFO: `/v3/projects/50cf08191acd4781804ff0d457e25a06/users/0e4538297c1943d8b3aa90d646823200/roles/63faaaf1760a4a0bad177ee6334a085b` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:23.675514 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf08191acd4781804ff0d457e25a06, user_id=0e4538297c1943d8b3aa90d646823200, role_id=63faaaf1760a4a0bad177ee6334a085b)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:23.679087 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:23.696665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 593/1190] 10.222.0.75 () {60 vars in 1483 bytes} [Tue Aug 23 23:31:23 2022] PUT /identity/v3/projects/50cf08191acd4781804ff0d457e25a06/users/0e4538297c1943d8b3aa90d646823200/roles/63faaaf1760a4a0bad177ee6334a085b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:31:29.801679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496afadc-96a2-4a02-8400-f53ad90f7b1d None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:29.802242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496afadc-96a2-4a02-8400-f53ad90f7b1d None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:29.802242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496afadc-96a2-4a02-8400-f53ad90f7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:29.850256 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-496afadc-96a2-4a02-8400-f53ad90f7b1d None None] MFA Rules not processed for user `1b2af050b82a486f8792bafb8ae392be`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:29.853141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-496afadc-96a2-4a02-8400-f53ad90f7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:29.933470 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:29.988059 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 598/1191] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:29 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:30.007688 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:30.010395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:30.152358 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b6452-cc03-4a1a-94aa-b5dca42352d4 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:30.157990 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84548f065a0240e2b700b2c9eecb8bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:30.159491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:30.159491 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:30.159979 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:30.205539 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a7ed-a7f2-4ecf-be22-1dd3f2e761e2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:30.205844 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a7ed-a7f2-4ecf-be22-1dd3f2e761e2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:30.206098 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a7ed-a7f2-4ecf-be22-1dd3f2e761e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:30.250898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-4bd8a7ed-a7f2-4ecf-be22-1dd3f2e761e2 None None] MFA Rules not processed for user `0e4538297c1943d8b3aa90d646823200`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:30.252341 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-4bd8a7ed-a7f2-4ecf-be22-1dd3f2e761e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:30.261068 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:30.265246 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:30.277114 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 594/1192] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:30 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:30.398196 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 599/1193] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:30 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:30.411376 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:30.413469 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:30.449504 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27117-faa3-4ed7-9898-a699ac368764 service glance] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:30.453855 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84548f065a0240e2b700b2c9eecb8bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:30.454893 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:30.455288 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:30.455645 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:30.592277 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:30.631035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:30.633929 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae51d-e2a8-4ec6-9436-129a88832976 service glance] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:30.664555 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 595/1194] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:30 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:39.570091 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c306c-1526-4254-b411-27171c197864 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:39.570699 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c306c-1526-4254-b411-27171c197864 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:39.570931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c306c-1526-4254-b411-27171c197864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:39.594697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-3f2c306c-1526-4254-b411-27171c197864 None None] MFA Rules not processed for user `cd0c7eb94921423293b16bf7c528b997`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:39.596503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-3f2c306c-1526-4254-b411-27171c197864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:39.609740 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 600/1195] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:31:39 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:39.978978 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406601-ef22-4d77-9c70-0caedc28d8f1 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:39.980003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406601-ef22-4d77-9c70-0caedc28d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:39.980003 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406601-ef22-4d77-9c70-0caedc28d8f1 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:39.981124 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 596/1196] 10.222.0.75 () {54 vars in 962 bytes} [Tue Aug 23 23:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:31:39.990695 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f74a-9dec-4732-ad93-2a4b14ee94d8 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:39.991001 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f74a-9dec-4732-ad93-2a4b14ee94d8 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:39.991455 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f74a-9dec-4732-ad93-2a4b14ee94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.040847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f977f74a-9dec-4732-ad93-2a4b14ee94d8 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:40.043359 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f977f74a-9dec-4732-ad93-2a4b14ee94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:40.172132 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 601/1197] 10.222.0.75 () {58 vars in 1059 bytes} [Tue Aug 23 23:31:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:40.178284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179883a-4a00-438a-9ac4-17bc801274d0 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:40.179346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179883a-4a00-438a-9ac4-17bc801274d0 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:40.179346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179883a-4a00-438a-9ac4-17bc801274d0 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.180473 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 597/1198] 10.222.0.75 () {54 vars in 912 bytes} [Tue Aug 23 23:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:40.188677 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7161e-dc6d-43d0-8539-762627c887a3 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:40.189167 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7161e-dc6d-43d0-8539-762627c887a3 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:40.197514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7161e-dc6d-43d0-8539-762627c887a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.220474 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-37a7161e-dc6d-43d0-8539-762627c887a3 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:40.221174 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-37a7161e-dc6d-43d0-8539-762627c887a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:40.238315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 602/1199] 10.222.0.75 () {58 vars in 1009 bytes} [Tue Aug 23 23:31:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:40.254008 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179883a-4a00-438a-9ac4-17bc801274d0 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:40.274907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179883a-4a00-438a-9ac4-17bc801274d0 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:40.299227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84548f065a0240e2b700b2c9eecb8bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:40.300241 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:40.300715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:40.301187 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.325071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:40.327527 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054650c-6dfa-42bf-a0fa-7eb36c1d6601 service glance] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:40.342622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 598/1200] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:40.864514 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea2ad7-946e-4f66-9a79-6b4686c41bf3 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:40.866159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea2ad7-946e-4f66-9a79-6b4686c41bf3 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:40.866159 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea2ad7-946e-4f66-9a79-6b4686c41bf3 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.866931 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 603/1201] 10.222.0.75 () {54 vars in 912 bytes} [Tue Aug 23 23:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:31:40.875151 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d74-3474-4670-88ea-941c2d5b225a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:40.875458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d74-3474-4670-88ea-941c2d5b225a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:40.875778 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86d74-3474-4670-88ea-941c2d5b225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:40.902142 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-4ad86d74-3474-4670-88ea-941c2d5b225a None None] MFA Rules not processed for user `d0bad6d774424470a1556d5c4e1db12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:40.903583 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-4ad86d74-3474-4670-88ea-941c2d5b225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:40.979412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 599/1202] 10.222.0.75 () {58 vars in 1009 bytes} [Tue Aug 23 23:31:40 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:40.992140 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea2ad7-946e-4f66-9a79-6b4686c41bf3 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:41.006131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea2ad7-946e-4f66-9a79-6b4686c41bf3 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:41.010409 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:41.011121 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.011318 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.011574 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.020462 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:41.021998 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22269f-ca08-441b-ac63-e93dcd6e9934 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:41.031922 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 604/1203] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:31:41.730249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78049f4-597d-42a7-b23c-44fe81d18d70 None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.730622 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78049f4-597d-42a7-b23c-44fe81d18d70 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.731362 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78049f4-597d-42a7-b23c-44fe81d18d70 None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.733267 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 600/1204] 10.222.0.75 () {54 vars in 962 bytes} [Tue Aug 23 23:31:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:41.745062 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06687-2898-490c-819a-099e5c2b1450 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.745515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06687-2898-490c-819a-099e5c2b1450 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.746440 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06687-2898-490c-819a-099e5c2b1450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.769855 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecda-84b1-47d2-8473-73514b093ecd None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.770412 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecda-84b1-47d2-8473-73514b093ecd None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.770888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecda-84b1-47d2-8473-73514b093ecd None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.773557 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-4df06687-2898-490c-819a-099e5c2b1450 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:41.773888 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 601/1205] 10.222.0.75 () {54 vars in 961 bytes} [Tue Aug 23 23:31:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:41.774996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-4df06687-2898-490c-819a-099e5c2b1450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:41.780315 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635ed8-6883-435c-9866-58514b5d7137 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.780898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635ed8-6883-435c-9866-58514b5d7137 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.781395 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635ed8-6883-435c-9866-58514b5d7137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.804888 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 605/1206] 10.222.0.75 () {58 vars in 1059 bytes} [Tue Aug 23 23:31:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:41.811170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a475-2dcd-4d66-b49f-f5d6a51beaa3 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.811657 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a475-2dcd-4d66-b49f-f5d6a51beaa3 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.812137 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575a475-2dcd-4d66-b49f-f5d6a51beaa3 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.813758 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 606/1207] 10.222.0.75 () {54 vars in 912 bytes} [Tue Aug 23 23:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:31:41.820503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.820861 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.821413 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.831081 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-2d635ed8-6883-435c-9866-58514b5d7137 None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:41.832339 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-2d635ed8-6883-435c-9866-58514b5d7137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:41.849753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:41.851222 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:41.862654 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 607/1208] 10.222.0.75 () {58 vars in 1009 bytes} [Tue Aug 23 23:31:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:41.875420 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:41.897713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa64ba-3511-4883-a936-dfd5b24c5009 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:41.903790 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:41.904519 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:41.905587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:41.905944 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:41.928112 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=100 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:41.938512 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:41.941172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:41.968934 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 608/1209] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:41 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:31:41.969236 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 602/1210] 10.222.0.75 () {58 vars in 1058 bytes} [Tue Aug 23 23:31:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:41.977048 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:41.994315 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e799f-45dd-4b62-9fcf-bb02fe337400 service neutron] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:42.004165 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:42.006144 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:42.006536 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:42.007020 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:42.009500 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:42.023317 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:42.025014 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:42.036862 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 609/1211] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:51.946664 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=64 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:52.032125 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=9 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:55.014481 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2bb04-93ca-40d9-a87e-fdaad55a8132 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:55.015426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2bb04-93ca-40d9-a87e-fdaad55a8132 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:55.015426 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2bb04-93ca-40d9-a87e-fdaad55a8132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:55.044547 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-43b2bb04-93ca-40d9-a87e-fdaad55a8132 None None] MFA Rules not processed for user `d0bad6d774424470a1556d5c4e1db12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:55.045836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-43b2bb04-93ca-40d9-a87e-fdaad55a8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:55.053769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 603/1212] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 23 23:31:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:31:55.068042 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:55.093296 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb9a7-c794-4202-b3e6-b10dda53c27f service placement] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:55.100838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:55.102169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:55.102564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:55.103148 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:55.119431 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:55.122691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073cbf0-7d2a-4d3b-9507-528feb77ab3d service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:55.138341 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 610/1213] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:56.073125 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078b15-9c5e-4541-9384-975231411c7b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:56.073838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078b15-9c5e-4541-9384-975231411c7b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:56.073838 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f078b15-9c5e-4541-9384-975231411c7b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:56.076560 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 604/1214] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:31:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:31:56.090382 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413d12b-8062-4019-b0b9-245915250494 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:56.091095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413d12b-8062-4019-b0b9-245915250494 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:56.091095 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413d12b-8062-4019-b0b9-245915250494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:56.130605 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-a413d12b-8062-4019-b0b9-245915250494 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:56.133224 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-a413d12b-8062-4019-b0b9-245915250494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:56.145156 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 611/1215] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:31:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:56.174929 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f078b15-9c5e-4541-9384-975231411c7b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:56.192175 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f078b15-9c5e-4541-9384-975231411c7b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:56.198035 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:56.198668 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:56.198939 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:56.199210 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:56.213269 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:56.215698 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32653d64-ee4f-4172-a318-45d41b7d90df service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:56.234487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 605/1216] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:31:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:03.584780 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096a6e-1533-40f0-837a-47dce6b70954 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:03.585621 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096a6e-1533-40f0-837a-47dce6b70954 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:03.585621 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096a6e-1533-40f0-837a-47dce6b70954 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:03.590503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 612/1217] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:32:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:32:03.694513 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:03.695086 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:03.695487 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:03.722203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:03.722891 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:03.734703 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 606/1218] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:32:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:03.763149 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096a6e-1533-40f0-837a-47dce6b70954 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:03.780617 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096a6e-1533-40f0-837a-47dce6b70954 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:03.793573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:03.794644 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:03.795151 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:03.795618 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:03.811838 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:03.814245 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649f86c-df95-4b21-9447-3735692fd08c service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:03.831429 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 613/1219] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:32:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:13.712263 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=12 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:13.825018 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=15 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:18.653773 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:18.668763 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab13f0-0953-4e88-b5be-e1623d6ab351 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:18.673545 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:18.674225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:18.674449 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:18.674705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:18.688416 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:18.690575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c7499-0c47-4306-8309-b93811d1ca58 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:18.711381 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 607/1220] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:32:18 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:32:21.007027 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e624-bc1a-4f50-8b73-39115caa0dc8 None None] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:21.008604 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e624-bc1a-4f50-8b73-39115caa0dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:21.009006 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896e624-bc1a-4f50-8b73-39115caa0dc8 None None] PATH_INFO: `/` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:21.011271 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 614/1221] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:32:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:32:21.019819 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6797-2746-4565-bf43-41c366dbc045 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:21.020973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6797-2746-4565-bf43-41c366dbc045 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:21.020973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6797-2746-4565-bf43-41c366dbc045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:21.048057 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-fc4b6797-2746-4565-bf43-41c366dbc045 None None] MFA Rules not processed for user `c7b8c451555a48468abd236dad2d1f75`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:21.049577 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-fc4b6797-2746-4565-bf43-41c366dbc045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:21.069841 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 608/1222] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:32:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:21.081964 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896e624-bc1a-4f50-8b73-39115caa0dc8 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:21.103959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896e624-bc1a-4f50-8b73-39115caa0dc8 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:21.111587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:21.116751 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:21.117025 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:21.117311 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:21.130169 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:21.132131 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eea998-087d-4b62-b0d2-a21e76ed6f6b service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:21.150026 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 615/1223] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:32:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:31.041796 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=9 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:31.143028 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=6 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:43.473867 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:43.474892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:43.474892 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:43.499400 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:43.500667 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:43.508111 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 609/1224] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:32:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:43.912160 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136ce3-debf-45c0-b6c0-23cbd870c916 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:43.912866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136ce3-debf-45c0-b6c0-23cbd870c916 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:43.912866 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136ce3-debf-45c0-b6c0-23cbd870c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:43.936829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-f2136ce3-debf-45c0-b6c0-23cbd870c916 None None] MFA Rules not processed for user `d0bad6d774424470a1556d5c4e1db12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:32:43.938051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f2136ce3-debf-45c0-b6c0-23cbd870c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:43.946361 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 616/1225] 10.222.0.75 () {58 vars in 1009 bytes} [Tue Aug 23 23:32:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:32:43.958126 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:43.968984 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c2aad-3272-40d0-9ebb-2722ced3781c None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:43.973548 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:43.974173 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:43.974446 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:43.974715 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:43.988202 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:43.989744 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e31a7-6ac2-45f4-ba2a-63f81410ed9b service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:43.999618 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 610/1226] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:32:43 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:53.931564 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:53.995188 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=9 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:08.510015 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e8fe-0d79-418f-9d23-99aec8689a16 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:08.510747 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e8fe-0d79-418f-9d23-99aec8689a16 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:08.511242 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e8fe-0d79-418f-9d23-99aec8689a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:08.542679 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-3d55e8fe-0d79-418f-9d23-99aec8689a16 None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:33:08.543833 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-3d55e8fe-0d79-418f-9d23-99aec8689a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:08.553126 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 617/1227] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:33:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:33:18.536479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:24.944705 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:24.945249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:24.945249 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:24.971058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:33:24.972571 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:24.981759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 611/1228] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:33:24 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:33:34.964190 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:34:26.795573 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:34:26.796211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:34:26.796211 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:34:26.817738 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:34:26.818970 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:34:26.826366 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 618/1229] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:34:26 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:34:36.812727 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=3 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:34:40.703071 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:34:40.729564 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47aaca-5eb8-42b8-935c-c578a97f8972 None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:34:40.737809 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:34:40.738523 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:34:40.738793 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:34:40.739059 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:34:40.749225 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:34:40.750836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:34:40.762264 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 612/1230] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:34:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:34:41.018686 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:34:41.041633 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bab29-fb42-467e-a170-8ed7292c0af1 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:34:41.046007 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:34:41.046647 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:34:41.047313 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:34:41.047584 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:34:41.058831 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:34:41.060397 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:34:41.070870 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 619/1231] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:34:41 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:34:50.758018 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=10 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:34:51.066051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=10 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:36:49.479659 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:49.505792 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0640e-1002-44e9-96e5-57086c9e183c service placement] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:49.512227 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:49.512890 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:49.513134 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:49.513432 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:49.523218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:49.524881 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:49.534704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 613/1232] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:49 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:49.732834 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:49.741704 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaa7d0-2a15-4ace-a423-c6d95974eb74 service neutron] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:49.745638 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:49.746340 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:49.746619 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:49.746887 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:49.757067 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:49.758498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026e75-d4ab-42d4-8176-62546f71d406 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:49.769517 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 620/1233] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:50.968517 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:50.978404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311c99-3246-4f92-9639-aa9c56b5dcd8 service nova] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:50.982346 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:50.983045 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:50.983394 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:50.983769 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:50.995557 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:50.997050 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:51.008170 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 614/1234] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:54.562484 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:54.563178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:54.563178 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:54.586556 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:36:54.587802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:36:54.596959 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 621/1235] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:36:54 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:36:55.430172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:55.442825 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897e0d-a453-450f-b779-0903d84b92e2 service neutron] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:55.451239 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:55.451565 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:55.452515 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:55.452515 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:55.462807 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:55.464554 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:55.476632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 615/1236] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:57.271058 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:57.283548 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26672-528e-4591-9766-449e0f7a56c2 None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:57.287746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:57.288671 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:57.289107 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:57.289516 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:57.299498 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:57.301423 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:57.311434 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 622/1237] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:57 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:36:57.920890 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:36:57.937116 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a60-50a7-4b74-8537-aadcdf3a7789 service placement] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:36:57.943650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:36:57.944602 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:36:57.945295 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:36:57.945925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:36:57.958602 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:36:57.960835 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:36:57.973301 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 616/1238] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:36:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:05.138099 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:05.153882 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba332-08b0-4ed2-bff9-8156c311183f service neutron] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:05.160286 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:05.160907 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:05.161185 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:05.161654 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:05.171589 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:05.174404 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:05.185997 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 623/1239] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:07.967683 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=28 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:15.182033 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=21 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:18.879172 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:18.893598 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3169ab-e9bd-4842-bd43-a146bfcecc58 service nova] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:18.899480 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:18.900176 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:18.900456 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:18.900907 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:18.910991 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:18.912717 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5c958-2182-445c-aa3d-a1faa93e8571 service nova] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:18.922973 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 617/1240] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:18 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:21.559373 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:21.570587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123364e-9359-453c-9bec-608c669ae1f4 service nova] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:21.576940 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b8c451555a48468abd236dad2d1f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:21.577572 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:21.577845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:21.578141 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:21.588627 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:21.590249 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:21.601802 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 624/1241] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:28.918684 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=6 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:31.596558 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=6 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:33.793177 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] REQUEST_METHOD: `POST` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:33.793777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:33.793777 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:33.815759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.auth.core [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] MFA Rules not processed for user `cd0c7eb94921423293b16bf7c528b997`. Rule list: `[]` (Enabled: `True`). {{(pid=88324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:37:33.817016 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:37:33.824980 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 618/1242] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:37:33 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:37:34.102134 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:34.112342 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fc0-1e40-4212-8ebf-9a5858c0ee36 service nova] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:34.117009 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:34.117631 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:34.118290 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:34.118562 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:34.126381 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:34.127847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc55a93-91b8-4cde-9a15-f54c74ed72d0 service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:34.136088 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 625/1243] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:37:34 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:37:43.810197 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=3 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:44.132270 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=6 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:38:06.656118 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:38:06.695382 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77ca51-5247-428f-b28e-8277f538001a None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:38:06.700116 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:38:06.700844 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:38:06.701632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:38:06.701632 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:38:06.739970 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:38:06.741596 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:38:06.754434 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 619/1244] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:38:06 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:38:16.752704 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=20 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:01.841045 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:01.841852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:01.841852 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:01.873966 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] MFA Rules not processed for user `48d7d40763a04b56bddfb0e576ce0df0`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:39:01.875195 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:01.883444 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 626/1245] 10.222.0.75 () {58 vars in 958 bytes} [Tue Aug 23 23:39:01 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:39:11.868920 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=7 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:39:47.757967 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:39:47.771133 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7154f-2949-465d-b523-0fb0c22374d7 service neutron] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:39:47.777650 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:39:47.779031 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:39:47.779319 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:39:47.779590 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:39:47.781651 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:39:47.820274 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:39:47.821915 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666a2d-b3fe-42d1-99ba-ddfa1cb96cb2 service placement] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:39:47.833015 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 620/1246] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:39:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:39:57.828736 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=15 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:48.357820 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:48.359777 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:48.386826 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ab60-e9a5-47fb-9814-35f09bffeaaa None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:48.390871 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:48.391571 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:48.391845 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:48.392147 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:48.465200 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:48.466543 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf768d-a854-4fe3-85dd-e49d0548e5fa service neutron] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:48.486024 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 627/1247] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:40:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:40:51.901140 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:51.901832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:51.901832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] PATH_INFO: `/` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:51.903043 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 621/1248] 10.222.0.75 () {54 vars in 921 bytes} [Tue Aug 23 23:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:40:51.915252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] REQUEST_METHOD: `POST` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:51.915776 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:51.916090 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:52.003252 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.auth.core [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] MFA Rules not processed for user `3453fc063e964847aa4aad6c2d4242c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:40:52.004552 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:52.015391 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 628/1249] 10.222.0.75 () {58 vars in 1018 bytes} [Tue Aug 23 23:40:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:40:52.027377 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:52.029347 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:52.048857 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cca52-8608-4b47-9df2-be3278f7498b None None] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:52.054200 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:52.054882 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:52.055160 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:52.055429 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:52.064765 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:52.066356 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:52.076570 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 622/1250] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:40:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:40:55.533854 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:55.546996 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2bb9e-7576-44d7-85da-4add3ae88f9b None None] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:55.552479 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:55.553149 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:55.553398 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:55.553691 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] PATH_INFO: `/v3/users/cd0c7eb94921423293b16bf7c528b997` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:55.555047 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0c7eb94921423293b16bf7c528b997)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:55.556172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: WARNING py.warnings [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:40:55.556172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: warnings.warn(msg) Aug 23 23:40:55.556172 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: Aug 23 23:40:55.557394 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:55.631433 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0c7eb94921423293b16bf7c528b997'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:55.640532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0c7eb94921423293b16bf7c528b997'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:55.660526 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0c7eb94921423293b16bf7c528b997'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:55.661278 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0c7eb94921423293b16bf7c528b997'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:55.661898 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0c7eb94921423293b16bf7c528b997'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:55.674698 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:55.680664 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 629/1251] 10.222.0.75 () {58 vars in 1224 bytes} [Tue Aug 23 23:40:55 2022] DELETE /identity/v3/users/cd0c7eb94921423293b16bf7c528b997 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:55.876101 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:55.888154 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d2bf5-5c81-4b59-85e4-236aa8798a1f service placement] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:55.947233 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:55.947898 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:55.948186 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:55.948458 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] PATH_INFO: `/v3/projects/4177193808b246afa915d83458b9780c` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:55.949589 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4177193808b246afa915d83458b9780c)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:55.950665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: WARNING py.warnings [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:40:55.950665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: warnings.warn(msg) Aug 23 23:40:55.950665 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: Aug 23 23:40:55.951906 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:56.010476 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4177193808b246afa915d83458b9780c', 'request_id': 'req-10cae46f-d775-457e-b293-aaa97e93c76b'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.024512 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4177193808b246afa915d83458b9780c', 'request_id': 'req-10cae46f-d775-457e-b293-aaa97e93c76b'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.033307 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4177193808b246afa915d83458b9780c', 'request_id': 'req-10cae46f-d775-457e-b293-aaa97e93c76b'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.058292 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] The token cache is being invalidate because project 4177193808b246afa915d83458b9780c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:40:56.058531 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.059216 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.060781 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 623/1252] 10.222.0.75 () {58 vars in 1233 bytes} [Tue Aug 23 23:40:55 2022] DELETE /identity/v3/projects/4177193808b246afa915d83458b9780c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:56.065697 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:56.067351 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:56.081843 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad861-a6de-4558-8aa0-453543b9f364 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:56.143895 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:56.144532 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:56.144811 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:56.145079 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] PATH_INFO: `/v3/users/1b2af050b82a486f8792bafb8ae392be` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:56.146207 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2af050b82a486f8792bafb8ae392be)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:56.148206 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:56.216616 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2af050b82a486f8792bafb8ae392be'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.225407 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2af050b82a486f8792bafb8ae392be'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.239453 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2af050b82a486f8792bafb8ae392be'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.240187 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2af050b82a486f8792bafb8ae392be'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.240779 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2af050b82a486f8792bafb8ae392be'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.258051 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 630/1253] 10.222.0.75 () {58 vars in 1224 bytes} [Tue Aug 23 23:40:56 2022] DELETE /identity/v3/users/1b2af050b82a486f8792bafb8ae392be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:40:56.445993 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:40:56.447459 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:40:56.462784 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cae46f-d775-457e-b293-aaa97e93c76b admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:40:56.532314 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:40:56.532813 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:40:56.533136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:40:56.533500 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] PATH_INFO: `/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:40:56.535575 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccb40be6d3442cd8209d85e37f8d9d6)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:40:56.538181 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:40:56.550154 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:40:56.591309 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccb40be6d3442cd8209d85e37f8d9d6', 'request_id': 'req-86af37fc-e5c9-4128-9b73-7250e7700986'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.597925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccb40be6d3442cd8209d85e37f8d9d6', 'request_id': 'req-86af37fc-e5c9-4128-9b73-7250e7700986'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.608323 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccb40be6d3442cd8209d85e37f8d9d6', 'request_id': 'req-86af37fc-e5c9-4128-9b73-7250e7700986'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.618925 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] The token cache is being invalidate because project 7ccb40be6d3442cd8209d85e37f8d9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:40:56.619203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.619981 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:40:56.621475 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 624/1254] 10.222.0.75 () {58 vars in 1233 bytes} [Tue Aug 23 23:40:56 2022] DELETE /identity/v3/projects/7ccb40be6d3442cd8209d85e37f8d9d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:41:06.249595 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:41:06.615826 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:41:48.785280 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:48.787518 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:48.882587 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3a652-2393-4c00-8d75-b4046549e3b0 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:48.941460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4243bac39ca441498a5fc88927c6dea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:48.942077 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:48.942354 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:48.942639 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:48.944460 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:49.031503 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:49.032891 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:49.053473 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 631/1255] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:41:48 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:41:50.372900 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:50.374338 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:50.439453 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af37fc-e5c9-4128-9b73-7250e7700986 admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:50.443369 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0bad6d774424470a1556d5c4e1db12c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:50.444011 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] REQUEST_METHOD: `GET` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:50.444279 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:50.444518 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:50.446759 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:50.525804 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:50.527284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:50.537625 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 625/1256] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:41:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:41:56.833108 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:56.834720 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:56.850753 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0de2c-97f3-4cbb-93c1-15b6b7baace4 service cinder] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:56.856392 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:56.857040 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:56.857320 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:56.857598 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] PATH_INFO: `/v3/users/48d7d40763a04b56bddfb0e576ce0df0` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:56.858847 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d7d40763a04b56bddfb0e576ce0df0)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:56.860858 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:56.879223 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:41:56.918370 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d7d40763a04b56bddfb0e576ce0df0'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:56.926986 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d7d40763a04b56bddfb0e576ce0df0'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:56.939823 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d7d40763a04b56bddfb0e576ce0df0'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:56.940513 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d7d40763a04b56bddfb0e576ce0df0'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:56.941111 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d7d40763a04b56bddfb0e576ce0df0'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:56.956988 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 632/1257] 10.222.0.75 () {58 vars in 1224 bytes} [Tue Aug 23 23:41:56 2022] DELETE /identity/v3/users/48d7d40763a04b56bddfb0e576ce0df0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:41:57.158883 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:57.172284 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d6b8-a8a7-40d6-9245-6cd27cc020aa service neutron] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:57.235414 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:57.236075 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:57.236354 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:57.236624 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] PATH_INFO: `/v3/projects/a3fd677093e744ec8172b32ac863696c` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:57.237801 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fd677093e744ec8172b32ac863696c)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:57.239753 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:57.302280 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fd677093e744ec8172b32ac863696c', 'request_id': 'req-6c0b0e57-5867-442e-ac9e-3008342709ad'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.305024 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:41:57.310684 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fd677093e744ec8172b32ac863696c', 'request_id': 'req-6c0b0e57-5867-442e-ac9e-3008342709ad'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.321912 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fd677093e744ec8172b32ac863696c', 'request_id': 'req-6c0b0e57-5867-442e-ac9e-3008342709ad'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.332832 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] The token cache is being invalidate because project a3fd677093e744ec8172b32ac863696c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:41:57.333120 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.333772 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.335298 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 626/1258] 10.222.0.75 () {58 vars in 1233 bytes} [Tue Aug 23 23:41:57 2022] DELETE /identity/v3/projects/a3fd677093e744ec8172b32ac863696c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:41:57.339597 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:57.341096 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:57.355829 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb554-6fc2-4614-96ba-7fd868b5c2c0 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:57.423004 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:57.423618 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:57.423917 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:57.424181 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] PATH_INFO: `/v3/users/0e4538297c1943d8b3aa90d646823200` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:57.438538 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4538297c1943d8b3aa90d646823200)` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:57.440548 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:57.491209 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4538297c1943d8b3aa90d646823200'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.501585 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4538297c1943d8b3aa90d646823200'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.515232 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4538297c1943d8b3aa90d646823200'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.516050 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4538297c1943d8b3aa90d646823200'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.516746 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.notifications [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4538297c1943d8b3aa90d646823200'} {{(pid=88323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.529294 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 633/1259] 10.222.0.75 () {58 vars in 1224 bytes} [Tue Aug 23 23:41:57 2022] DELETE /identity/v3/users/0e4538297c1943d8b3aa90d646823200 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:41:57.727406 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Authenticating user token {{(pid=88324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:41:57.729095 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.fernet_utils [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:41:57.742136 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0e57-5867-442e-ac9e-3008342709ad admin admin] Validating token access rules against request {{(pid=88324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:41:57.807058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7bbb00e65c4b7393cbc41f848a6216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a6d06c119f40359a0b6c352385f165', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:41:57.807902 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:41:57.808203 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:41:57.809228 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] PATH_INFO: `/v3/projects/50cf08191acd4781804ff0d457e25a06` {{(pid=88324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:41:57.826218 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cf08191acd4781804ff0d457e25a06)` {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:41:57.829404 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] RBAC: Authorization granted {{(pid=88324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:41:57.884836 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cf08191acd4781804ff0d457e25a06', 'request_id': 'req-c006188b-ca98-41f3-b60a-8f7faac1ce7c'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.891551 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cf08191acd4781804ff0d457e25a06', 'request_id': 'req-c006188b-ca98-41f3-b60a-8f7faac1ce7c'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.901206 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cf08191acd4781804ff0d457e25a06', 'request_id': 'req-c006188b-ca98-41f3-b60a-8f7faac1ce7c'} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.912771 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] The token cache is being invalidate because project 50cf08191acd4781804ff0d457e25a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:41:57.913058 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.913692 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG keystone.notifications [None req-c006188b-ca98-41f3-b60a-8f7faac1ce7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:41:57.915728 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: [pid: 88324|app: 0|req: 627/1260] 10.222.0.75 () {58 vars in 1233 bytes} [Tue Aug 23 23:41:57 2022] DELETE /identity/v3/projects/50cf08191acd4781804ff0d457e25a06 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:42:07.525921 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:DELETE=19,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:42:07.909710 dv-osbrick-853458-3-ceph devstack@keystone.service[88324]: DEBUG dbcounter [-] [88324] Writing DB stats keystone:SELECT=60,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:44:49.697020 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Authenticating user token {{(pid=88323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:44:49.698673 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:44:49.786170 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e1cad-e896-45f5-8623-ba53e6ccc4b7 admin admin] Validating token access rules against request {{(pid=88323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:44:49.849158 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3453fc063e964847aa4aad6c2d4242c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8ab3e0badff4106b560d809f6157c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:44:49.849775 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] REQUEST_METHOD: `GET` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:44:49.850057 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] SCRIPT_NAME: `/identity` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:44:49.850331 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:44:49.852412 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.fernet_utils [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:44:49.864515 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:44:49.866123 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d53d1-7a6f-436d-b360-62ea9dfe6269 service placement] RBAC: Authorization granted {{(pid=88323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:44:49.876713 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: [pid: 88323|app: 0|req: 634/1261] 10.222.0.75 () {60 vars in 1365 bytes} [Tue Aug 23 23:44:49 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:44:59.872340 dv-osbrick-853458-3-ceph devstack@keystone.service[88323]: DEBUG dbcounter [-] [88323] Writing DB stats keystone:SELECT=62 {{(pid=88323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}